DCT

1:23-cv-00190

Parus Holdings Inc v. Amazon.com Inc

Log In
Key Events
Complaint
complaint Intelligence

I. Executive Summary and Procedural Information

  • Parties & Counsel:
  • Case Identification: 1:23-cv-00190, D. Del., 02/17/2023
  • Venue Allegations: Venue is alleged to be proper in the District of Delaware because Defendant has transacted business and committed acts of direct infringement within the district.
  • Core Dispute: Plaintiff alleges that Defendant's Alexa devices and associated cloud services infringe three expired U.S. patents related to systems for retrieving specific information from online sources using voice commands.
  • Technical Context: The technology at issue falls within the domain of voice-activated digital assistants, a market segment dominated by platforms like Amazon's Alexa, which allow users to retrieve information and control devices via speech.
  • Key Procedural History: The complaint asserts three patents from the same family, all of which have expired. This procedural posture limits Plaintiff's potential remedies to monetary damages for past infringement, precluding injunctive relief.

Case Timeline

Date Event
2000-02-04 Priority Date for '190, '992, and '981 Patents
2009-04-07 U.S. Patent No. 7,516,190 Issued
2016-06-28 U.S. Patent No. 9,377,992 Issued
2017-01-01 Alleged Infringement by Accused Products Begins (approx.)
2019-06-11 U.S. Patent No. 10,320,981 Issued
2021-02-06 U.S. Patent No. 10,320,981 Expired
2022-05-10 U.S. Patent No. 7,516,190 Expired
2022-11-16 U.S. Patent No. 9,377,992 Expired
2023-02-17 Complaint Filed

II. Technology and Patent(s)-in-Suit Analysis

U.S. Patent No. 7,516,190 - Personal Voice-Based Information Retrieval System

  • Patent Identification: U.S. Patent No. 7,516,190, "Personal Voice-Based Information Retrieval System," issued April 7, 2009 Compl. ¶10
  • The Invention Explained:
    • Problem Addressed: The patent's background describes conventional methods of accessing internet information as "time-consuming and complicated," often requiring a user to navigate through vast amounts of irrelevant data on a computer, which is less convenient than using a telephone '190 Patent, col. 1:12-32
    • The Patented Solution: The invention proposes a personalized system where a user pre-defines a specific portion of a website they wish to access and assigns a unique voice command to it '190 Patent, abstract Using a "clipping client," the user creates a record containing the website's URL, a "recognition grammar" (the voice command), and instructions for extracting the desired content '190 Patent, col. 3:1-11 When the user later speaks the command into a telephone, the system automatically retrieves only that pre-selected information and reads it back to the user in an audio format '190 Patent, col. 2:6-27
    • Technical Importance: The technology aimed to make targeted information retrieval from the web practical over simple voice-only devices like telephones, personalizing the experience before the advent of smartphones with full-featured graphical browsers '190 Patent, col. 1:33-47
  • Key Claims at a Glance:
    • The complaint asserts independent Claim 1 Compl. ¶19
    • Claim 1 outlines a method for users to obtain information from a "pre-defined portion of a pre-selected web site" in audio format, comprising the steps of:
      • Providing a computer with a speech processor connected to the internet and a phone.
      • Providing a URL for a pre-selected web site.
      • Designating a "pre-defined portion" of that site.
      • Identifying a "named object" associated with the content.
      • Generating a "regular expression" based on the site portion and named object to describe a search pattern.
      • Providing a speech command corresponding to the regular expression.
      • Converting the speech command to a digital command and retrieving the information corresponding to the regular expression.
      • Converting the retrieved information into an audio message and forwarding it to the user.
    • The complaint does not explicitly reserve the right to assert dependent claims but notes that its selection of claims is not limiting Compl. ¶13

U.S. Patent No. 9,377,992 - Personal Voice-Based Information Retrieval System

  • Patent Identification: U.S. Patent No. 9,377,992, "Personal Voice-Based Information Retrieval System," issued June 28, 2016 Compl. ¶11
  • The Invention Explained:
    • Problem Addressed: The patent addresses the same problem as its parent '190 Patent: the difficulty and inefficiency of retrieving specific, relevant information from computer networks using then-current methods '992 Patent, col. 1:23-42
    • The Patented Solution: The '992 Patent claims a method where a user employs a "clipping client" to identify and separate a portion of information of interest from a larger information source, such as a webpage '992 Patent, col. 3:5-19 This process generates a "content descriptor file" that describes the desired content and its location within the source '992 Patent, col. 3:35-42 When a user issues a corresponding speech command, a media server selects an appropriate "information source retrieval instruction," uses a web browsing server to access and retrieve only the pre-defined portion of information, converts it to an audio message, and transmits it to the user '992 Patent, abstract
    • Technical Importance: This patent elaborates on the concept of pre-defining and isolating web content for voice access, focusing on the system architecture involving a "clipping client" and "content descriptor file" as the mechanism for personalization '992 Patent, col. 3:5-48
  • Key Claims at a Glance:
    • The complaint asserts independent Claim 1 Compl. ¶59
    • Claim 1 details a method for retrieving information using speech commands, comprising the steps of:
      • Receiving a speech command at a speech recognition engine coupled to a media server, where the information source is periodically updated.
      • Selecting, by the media server, an "information source retrieval instruction" corresponding to the speech command.
      • Accessing, by a "web browsing server," a portion of an information source previously identified by a user with a "clipping client."
      • The clipping client generates a "content descriptor file" describing the content and its location.
      • Retrieving only the specified portion of information.
      • Converting the retrieved information into an audio message via a speech synthesis engine.
      • Transmitting the audio message to the user's device.
    • The complaint states that infringement by way of additional claims will be disclosed during discovery Compl. ¶13

U.S. Patent No. 10,320,981 - Personal Voice-Based Information Retrieval System

  • Patent Identification: U.S. Patent No. 10,320,981, "Personal Voice-Based Information Retrieval System," issued June 11, 2019 Compl. ¶12
  • Technology Synopsis: The '981 patent, also from the same family, claims a method for voice-based information retrieval involving a "user-defined search." A speech command is converted into a data message, and a speech-recognition engine selects a specific grammar to fetch content associated with that message from one or more websites '981 Patent, claim 1(a) A web-browsing server uses a "content extractor" and a "content-descriptor file" to separate and retrieve only the relevant portion of information from a web page, which is then converted to audio and sent to the user '981 Patent, claim 1(c)
  • Asserted Claims: The complaint asserts independent Claim 1 Compl. ¶81
  • Accused Features: The complaint accuses Amazon's integrated Alexa ecosystem, alleging the Amazon Echo acts as the voice-enabled device, the Alexa Voice Service contains the speech-recognition engine and interactive voice response application, and that user-defined searches are provided by Alexa Skills Compl. ¶¶84-86

III. The Accused Instrumentality

Product Identification

The accused instrumentalities are "Amazon's Alexa devices and associated servers," including products from the Echo, Echo Dot, Amazon Tap, Echo Look, Echo Show, Echo Spot, Echo Plus, Echo Flex, and Echo Auto lines Compl. ¶4 Compl. ¶14

Functionality and Market Context

  • The complaint characterizes the accused system as a cloud-based voice service that interacts with remote devices like the Amazon Echo smart speaker Compl. ¶22 A user's spoken command is transmitted to the Alexa Voice Service (AVS), which includes a speech recognition engine Compl. ¶64 AVS analyzes the request and routes it to an appropriate application, or "Skill" Compl. ¶26 An architectural diagram illustrates the flow of a user's voice request from an Alexa device to the Alexa Voice Service (AVS) cloud, processing by AWS Lambda, and the return of a voice response Compl. p. 9
  • The complaint alleges that these Skills, which can be created by Amazon or third-party developers, access information from pre-selected web sites (e.g., the "Tide Pool" skill accessing tidesandcurrents.noaa.gov) Compl. ¶26 Compl. ¶28 The Skill retrieves the specified data, which is then processed by AVS, converted from text to speech, and sent as an audio response to the user's device Compl. ¶53 Compl. ¶55 A user interaction flow diagram shows how a customer command is processed by a "Your Alexa Skill" service, which returns a text and graphical response that Alexa converts to speech for the user Compl. p. 11

IV. Analysis of Infringement Allegations

U.S. Patent No. 7,516,190 Infringement Allegations

Claim Element (from Independent Claim 1) Alleged Infringing Functionality Complaint Citation Patent Citation
(a) providing a computer having a speech processor, said computer being operatively connected to the internet and to at least one phone; Amazon provides the Alexa system, which includes the cloud-based Alexa Voice Service (the computer with a speech processor) and is accessible by internet-connected devices and phone applications (Compl. ¶24). ¶23; ¶24 col. 5:17-21
(c) using said computer to designate a pre-defined portion of the pre-selected web site which contains the information to be retrieved; A skill developer provides code and instructions to the Alexa system that designates a specific portion of a website from which to retrieve information, such as the Tide Pool skill accessing part of the noaa.gov website. ¶27; ¶28 col. 3:1-11
(e) using said computer to generate a regular expression based on said pre-defined portion of said pre-selected web site and said named object, said regular expression corresponding to said content of said information to be retrieved, wherein said regular expression is a text string used for describing a search pattern; On information and belief, a skill developer provides code/instructions that cause the Alexa system to generate and use a regular expression associated with the content to be retrieved. ¶31; ¶32 col. 4:38-41
(f) providing a speech command to said speech processor, said speech command corresponding to said regular expression; Skill developers provide sample "utterances" (e.g., "Alexa, get high tide for Seattle"), which are the speech commands that correspond to the alleged regular expression. ¶33; ¶34 col. 2:13-17
(m) said computer retrieving the information from the pre-defined portion of the pre-selected web site corresponding to said regular expression when the requested information is found...; The Alexa system, via a specific Skill like Tide Pool, retrieves information from the designated portion of the pre-selected website (noaa.gov) that corresponds to the user's command. ¶46; ¶47; ¶48 col. 6:1-27
(p) said speech processor converting said retrieved information into an audio message; and (q) said speech processor forwarding said audio message to a user. The Alexa Voice Service includes a speech-synthesis engine that converts the retrieved text-based information into speech and transmits the resulting audio message to the user's Alexa device. ¶52; ¶53; ¶54; ¶55 col. 5:58-65

U.S. Patent No. 9,377,992 Infringement Allegations

Claim Element (from Independent Claim 1) Alleged Infringing Functionality Complaint Citation Patent Citation
receiving a speech command from the user via the electronic communication device at a speech recognition engine coupled to a media server, ... wherein the information source is periodically updated with information; A user speaks to an Alexa device (e.g., Echo), which sends the command to the Alexa Voice Service (speech recognition engine) and AWS Lambda (media server). The information source, like the noaa.gov tide website, is periodically updated. ¶63; ¶64; ¶68 col. 5:29-37
selecting, by the media server, at least one appropriate information source retrieval instruction corresponding to the recognition grammar established for the speech command, wherein the at least one appropriate information source retrieval instruction is stored in a database associated with the server; The Alexa Voice Service selects from sample utterances (recognition grammar) to invoke a skill (information source retrieval instruction) that is stored in a database. ¶67; ¶71; ¶72 col. 3:49-60
accessing, by a web browsing server, a portion of the information source including only a portion of information previously identified by the user of interest to the user by using a clipping client to separate the portion of the information... wherein the clipping client generates a content descriptor file...; A skill like Tide Pool acts as a web browsing server to access a portion of a website (noaa.gov). The complaint alleges that the actions of a skill developer in defining the skill's functionality satisfy the "using a clipping client" limitation. ¶73; ¶74 col. 3:5-35
converting the information retrieved from said information source into an audio message by a speech synthesis engine, the speech synthesis engine coupled to the media server; and The Alexa Voice Service includes a speech-synthesis engine that converts the text retrieved by the skill into an audio message. ¶75; ¶76 col. 5:18-24
transmitting said audio message to the electronic communication device for the user. The Alexa Voice Service transmits the synthesized audio message back to the user's Echo device. ¶77; ¶78 col. 5:61-65

Identified Points of Contention

  • Scope Questions: An analytical focus may be on whether the role of a third-party developer creating a public Alexa Skill falls within the scope of a "user" creating a "user-defined record" or using a "clipping client" for personal information retrieval, as described in the patents. The patents' language and figures suggest a system for end-user personalization, which raises the question of whether a developer platform for mass distribution meets these limitations.
  • Technical Questions: The infringement theory for the '190 patent hinges on the allegation that Alexa's "sample utterances" and "intents" correspond to the claimed "regular expression" Compl. ¶34 A point of contention may be whether Alexa's natural language understanding model, which maps phrases to functions, is technically equivalent to the patent's description of a "text string used for describing a search pattern" for parsing web content. The complaint makes this allegation on "information and belief" Compl. ¶32, suggesting it may be a key area for discovery.

V. Key Claim Terms for Construction

  • The Term: regular expression (from '190 Patent, Claim 1)

  • Context and Importance: This term is central to the infringement allegation against the '190 patent. The complaint equates Amazon's system of "intents" and "sample utterances" with this term Compl. ¶33 Compl. ¶34 The viability of the infringement claim may depend on whether this construction is adopted. Practitioners may focus on this term because its definition could determine if Alexa's natural language processing architecture is equivalent to the specific search-and-parse mechanism described in the patent.

  • Intrinsic Evidence for Interpretation:

    • Evidence for a Broader Interpretation: The claim itself provides a definition: "wherein said regular expression is a text string used for describing a search pattern" '190 Patent, col. 14:1-3 Plaintiff may argue that any set of rules or code that defines a pattern for finding information, such as an Alexa intent, functionally meets this definition.
    • Evidence for a Narrower Interpretation: The patent specification includes an exemplary content descriptor file with a field labeled "Regular expression" containing a string with technical regex syntax: WEB SERVICES: (.+) Forecast FOUR-DAY FORECAST (\S+) (\S+) HIGH (\S+) F... '190 Patent, col. 4:29-37 A party could argue this example limits the term's scope to such formal, symbolic text strings, as distinct from the more abstract "intent" model used in modern voice assistants.

  • The Term: clipping client (from '992 Patent, Claim 1)

  • Context and Importance: The complaint alleges that a skill developer's actions in creating a skill satisfy the "using a clipping client" limitation Compl. ¶73 The case may turn on whether the "user" performing the clipping is the end-user of the voice assistant or the third-party developer of the application.

  • Intrinsic Evidence for Interpretation:

    • Evidence for a Broader Interpretation: The specification describes the clipping client as an "engine" that "allows a user to create a set of instructions... by 'clipping' information from the identified web site" '992 Patent, col. 3:5-11 Plaintiff may contend that the Alexa Skills Kit functionally serves as this "engine" for developers, who are a type of "user."
    • Evidence for a Narrower Interpretation: Figure 1 of the patent depicts an end-user 100 directly operating the "clipping client" 110 on their personal computer 102 '992 Patent, Fig. 1 This illustration, combined with the title "Personal Voice-Based Information Retrieval System," may support an interpretation that the "clipping client" is a tool for end-user personalization, not a platform for third-party application development.

VI. Other Allegations

  • Indirect Infringement: The complaint makes a general allegation of indirect infringement Compl. ¶15 but does not plead specific facts to support the elements of knowledge and intent for induced or contributory infringement.
  • Willful Infringement: The complaint alleges that Amazon had "knowledge of the patents-in-suit since prior to the date of this Complaint" Compl. ¶16 This is a conclusory allegation, as the complaint does not provide specific facts, such as the sending of a notice letter, to substantiate pre-suit knowledge.

VII. Analyst's Conclusion: Key Questions for the Case

  • A core issue will be one of definitional scope and the role of the user: Can the actions of a third-party software developer using the Alexa Skills Kit to create a public-facing application be construed to meet claim limitations describing a "user" employing a "clipping client" to create personalized retrieval rules? The answer may depend on whether the court views the "user" as the end-consumer of the voice service or the developer of the application running on it.
  • A second key question will be one of technical equivalence: Does Amazon's modern, intent-based natural language understanding system, which maps a range of spoken phrases to a pre-defined function, perform the same function in substantially the same way to achieve the same result as the claimed method of generating and using a "regular expression" to parse web content?
  • Finally, as all asserted patents have expired, the case will be centered on past damages. Should infringement be established, a central question will be the determination of a reasonable royalty for the use of the patented technology during the statutory damages period, focusing on the value the claimed invention contributed to the accused Alexa ecosystem.
Loading Complaint