1:23-cv-03471
Hayden Ai Tech Inc v. Safe Fleet Holdings LLC
I. Executive Summary and Procedural Information
- Parties & Counsel:
- Plaintiff: Hayden AI Technologies, Inc. (Delaware)
- Defendant: Safe Fleet Holdings LLC; Safe Fleet Acquisition Corp.; Seon Holdings Corp.; Seon Design (USA) Corp.; Rear View Safety, Inc. (collectively, "Defendants")
- Plaintiff's Counsel: White & Case LLP
- Case Identification: 1:23-cv-03471, E.D.N.Y., 02/26/2025
- Venue Allegations: Plaintiff alleges venue is proper because Defendants conduct business, offer products, and have regular and established places of business within the Eastern District of New York, and have committed acts of infringement in the district.
- Core Dispute: Plaintiff alleges that Defendants' "ClearLane" automated bus lane enforcement system infringes two patents related to mobile, AI-powered systems for detecting traffic violations.
- Technical Context: The technology involves using vehicle-mounted camera systems with on-board artificial intelligence to automatically identify and document traffic infractions, such as illegally blocking a dedicated bus lane, to improve urban transit efficiency.
- Key Procedural History: This Fourth Amended Complaint follows an original complaint and several amendments. The complaint includes extensive allegations of trade secret misappropriation, asserting that Defendants improperly obtained Plaintiff's confidential investor presentations and conducted "product espionage" on Plaintiff's systems installed on New York City buses to inform the development of their competing product.
Case Timeline
| Date | Event |
|---|---|
| 2014-09-22 | Safe Fleet announces acquisition of Seon |
| 2016-05-31 | Safe Fleet acquires Rear View Safety, Inc. (approximate) |
| 2018-12-31 | Defendants begin discussions with NY MTA (by or before) |
| 2019-01-01 | Hayden AI is founded (approximate) |
| 2019-06-21 | Defendants submit proposal to NY MTA for an ABLE system |
| 2020-10-16 | U.S. Patent No. 11,003,919 Priority Date |
| 2020-11-09 | U.S. Patent No. 11,164,014 Priority Date |
| 2021-05-11 | U.S. Patent No. 11,003,919 Issues |
| 2021-11-02 | U.S. Patent No. 11,164,014 Issues |
| 2023-04-30 | Safe Fleet authors "Whitepaper" for NY MTA ABLE program (approximate) |
| 2025-02-26 | Fourth Amended Complaint is filed |
II. Technology and Patent(s)-in-Suit Analysis
U.S. Patent No. 11,003,919 - "Systems and Methods for Detecting Traffic Violations Using Mobile Detection Devices"
- Patent Identification: U.S. Patent No. 11,003,919, "Systems and Methods for Detecting Traffic Violations Using Mobile Detection Devices," issued May 11, 2021 Compl. ¶90
The Invention Explained
- Problem Addressed: The patent's background section notes that traditional automated traffic enforcement solutions are often logic-based and can yield high false-positive detection rates, with some as high as 80% '919 Patent, col. 1:40-44 The complaint characterizes these prior art systems as static and rule-based Compl. ¶98
- The Patented Solution: The invention describes a system of mobile "edge devices" that capture video of a potential traffic violation '919 Patent, abstract An initial detection is made on a first device, which transmits data to a server '919 Patent, col. 2:13-19 A second device captures the same vehicle at a later time and also transmits data '919 Patent, col. 2:27-33 The server makes a final determination that a violation has occurred by comparing the data from the two separate devices, including license plate strings, vehicle attributes, location data, and the elapsed time between the two sightings '919 Patent, col. 2:64-67
- Technical Importance: This multi-device corroboration method is positioned as a more scalable and accurate system for detecting traffic violations than prior art by leveraging deep learning models and computer vision on mobile devices Compl. ¶98
Key Claims at a Glance
- The complaint asserts infringement of at least Claim 1 Compl. ¶102
- The essential elements of independent Claim 1 include:
- Capturing a first video of a vehicle and restricted area on a first edge device at a first point in time.
- Identifying the vehicle, restricted area, vehicle attributes, and license plate string from the video using a computer vision library and a deep learning model on the device.
- Bounding the vehicle and restricted area in first bounding boxes and detecting a first potential violation based on their overlap.
- Transmitting data including the license plate string from the first edge device to a server.
- Repeating the capture, identification, bounding, and detection steps on a second edge device at a second point in time to identify a second potential violation.
- Transmitting corresponding data from the second edge device to the server.
- Determining, at the server, that a traffic violation has occurred based on an elapsed time and a comparison of the data received from the first and second edge devices. Compl. ¶95
- The complaint does not explicitly reserve the right to assert dependent claims for the '919 Patent.
U.S. Patent No. 11,164,014 - "Lane Violation Detection Using Convolutional Neural Networks"
- Patent Identification: U.S. Patent No. 11,164,014, "Lane Violation Detection Using Convolutional Neural Networks," issued November 2, 2021 Compl. ¶119
The Invention Explained
- Problem Addressed: The patent identifies the same problem as the '919 Patent: prior art logic-based bus lane enforcement systems yielded extremely high false positive rates '014 Patent, col. 1:50-54 Additionally, it notes that lane detection is a distinct technical challenge, as models trained to recognize objects like vehicles are often not suitable for detecting roadway lanes '014 Patent, col. 1:55-59
- The Patented Solution: The invention discloses a method for on-device detection using a specific dual-network architecture. A first convolutional neural network (CNN) is used to detect and bound a vehicle in a video frame. A separate, multi-headed second CNN is used to detect and bound multiple roadway lanes as polygons, identifying at least one as a "lane-of-interest" (LOI). A potential violation is then detected based on the overlap between the vehicle's bounding box and the LOI polygon. '014 Patent, abstract '014 Patent, col. 2:10-25
- Technical Importance: This approach aims to achieve a more accurate and robust on-device detection system by using specialized and separate neural networks for the distinct tasks of vehicle detection and lane detection Compl. ¶127
Key Claims at a Glance
- The complaint asserts infringement of at least Claim 1 Compl. ¶131
- The essential elements of independent Claim 1 include:
- Cropping and resizing video frames from an edge device's image sensor.
- Bounding a vehicle detected in the video frames in a vehicle bounding box, where the vehicle is detected and bounded using a first convolutional neural network.
- Bounding a plurality of roadway lanes detected in the video frames in a plurality of polygons, using a multi-headed second convolutional neural network separate from the first.
- Identifying at least one of the polygons as a lane-of-interest (LOI) polygon.
- Translating coordinates into a uniform coordinate domain.
- Detecting a potential traffic violation based in part on an overlap of the vehicle bounding box and the LOI polygon. Compl. ¶124
- The complaint does not explicitly reserve the right to assert dependent claims for the '014 Patent.
III. The Accused Instrumentality
Product Identification
- The "ClearLane" automated bus lane enforcement system, also referred to as the "SF ABLE System" Compl. ¶5 Compl. ¶74
Functionality and Market Context
- The accused system is described as using a context camera, an ALPR camera, a purpose-built computer with inertial sensors, a GPS receiver, and a cellular router to identify vehicles and create an evidence package for ticket processing Compl. ¶63 A diagram in the complaint outlines a process where cameras capture license plate details, algorithms process business rules against the vehicle, an evidence package is formed, and the package is sent for review Compl. ¶63
- The complaint alleges that ClearLane is a "copycat product" positioned in direct competition with Plaintiff's system and offered to municipal transit agencies, including the New York MTA Compl. ¶64 Compl. ¶70
IV. Analysis of Infringement Allegations
11,003,919 Infringement Allegations
| Claim Element (from Independent Claim 1) | Alleged Infringing Functionality | Complaint Citation | Patent Citation |
|---|---|---|---|
| capturing a first video of a vehicle and a restricted road area using one or more video image sensors of a first edge device... | The ClearLane system uses cameras mounted on a bus (an edge device) to capture video of vehicles in bus lanes Compl. ¶74 | ¶74 | col. 9:36-40 |
| determining a location of the vehicle using in part a first positioning data obtained from a first positioning unit of the first edge device | The system relies on a GPS receiver to determine the location of the vehicle and processes business rules based on that location data (Compl. ¶107). | ¶107 | col. 10:53-57 |
| identifying... the vehicle, the restricted road area, a first set of vehicle attributes... and a first alphanumeric string representing a license plate number... by applying a... deep learning model... | The system uses "advanced algorithms" and "computer vision algorithms" to identify vehicles, their attributes, and license plates from video (Compl. ¶75; Compl. ¶109; Compl. ¶85). | ¶109 | col. 10:1-15 |
| bounding... the vehicle and the restricted road area in the first frame in a plurality of first bounding boxes | The system is alleged to employ the use of bounding boxes to identify vehicles and restricted road areas (Compl. ¶82; Compl. ¶111). | ¶111 | col. 10:20-23 |
| detecting, at the first edge device, a first potential traffic violation... based in part on overlap of the plurality of the first bounding boxes and transmitting at least the first alphanumeric string... | The system detects violations and sends an "evidence package," including license plate data and vehicle attributes, to a server for review (Compl. ¶112). | ¶112 | col. 10:41-52 |
| capturing a second video... using one or more video image sensors of a second edge device... at a second point in time after the first point in time | The system is alleged to be able to identify violators by "matching the images and metadata captured by multiple buses" Compl. ¶115 | ¶115 | col. 11:13-22 |
| determining, at the server, that a traffic violation has occurred based on an elapsed time... and based on a comparison of the first alphanumeric string with the second alphanumeric string... | The server is alleged to match and correlate metadata from multiple buses, and the system's algorithms determine the "length of time" a vehicle has been blocking the bus lane (Compl. ¶116). | ¶116 | col. 12:50-67 |
- Identified Points of Contention: A central question may be whether the accused system's use of data from "multiple buses" Compl. ¶115 satisfies the claim requirement of a systematic, two-device corroboration method. The analysis will likely focus on whether the server-side logic of the ClearLane system is configured to require and compare data from two distinct edge devices, captured at different times, as a condition for confirming a violation, or if it operates differently.
11,164,014 Infringement Allegations
| Claim Element (from Independent Claim 1) | Alleged Infringing Functionality | Complaint Citation | Patent Citation |
|---|---|---|---|
| cropping and resizing one or more video frames of a video captured by one or more video image sensors of an edge device | The complaint alleges the ClearLane system "employs cameras to capture the license plate details by cropping and resizing a video frame from a video device" (Compl. ¶135). | ¶135 | col. 29:3-7 |
| bounding... a vehicle detected from the one or more video frames... in a vehicle bounding box... using a first convolutional neural network | The system uses "[a]dvanced algorithms" to determine vehicle position and location, and is alleged to bound vehicles in bounding boxes Compl. ¶136 A screenshot shows a vehicle outlined in a red bounding box Compl. ¶136 | ¶136 | col. 28:1-4 |
| bounding... a plurality of lanes of a roadway detected from the one or more video frames in a plurality of polygons... using multiple heads of a multi-headed second... network | The system is alleged to identify driving lanes and determine the bus's location relative to the bus lane (Compl. ¶75). A provided screenshot shows both vehicles and roadway lanes highlighted with colored overlays, which the complaint alleges constitutes bounding in polygons (Compl. ¶111; Compl. ¶137). | ¶111 | col. 28:18-24 |
| translating coordinates in the cropped and resized video frames into new coordinates based on a uniform coordinate domain | The complaint makes a direct allegation that the accused system practices this step, though it does not provide specific factual support beyond the conclusory statement (Compl. ¶138). | ¶138 | col. 31:4-11 |
| detecting... a potential traffic violation based in part on an overlap of at least part of the vehicle bounding box and at least part of the LOI polygon | The complaint alleges the system detects violations based on the overlap of vehicle and lane bounding boxes/polygons (Compl. ¶139). A screenshot showing a vehicle partially inside a highlighted bus lane supports this allegation of overlap-based detection (Compl. ¶139). | ¶139 | col. 2:21-25 |
- Identified Points of Contention: The infringement analysis for the '014 Patent may turn on the specific software architecture of the ClearLane system. A key question is whether the system's "advanced algorithms" Compl. ¶136 utilize two separate convolutional neural networks-one for vehicles and a multi-headed one for lanes-as strictly required by the claim language. Evidence from the accused product's source code and design documents will be central to determining if its architecture matches this specific, claimed configuration.
V. Key Claim Terms for Construction
The Term: "second edge device" (from '919 Patent, Claim 1)
Context and Importance: Claim 1 requires a multi-step method involving data from a "first edge device" and a "second edge device." The construction of this term is critical because the infringement theory relies on the accused system's alleged ability to match data from "multiple buses" Compl. ¶115 Practitioners may focus on whether "second edge device" means any other device in a fleet that happens to capture the same vehicle, or if it implies a more integrated and defined system architecture where two devices are systematically paired for corroboration.
Intrinsic Evidence for Interpretation:
- Evidence for a Broader Interpretation: The patent specification describes a system comprising a "plurality of edge devices 102" that communicate with a server '919 Patent, col. 7:51-52 This general language could support an interpretation where any two devices in the network can function as the "first" and "second" devices without a pre-defined relationship.
- Evidence for a Narrower Interpretation: Figure 1A of the patent depicts two distinct devices, 102A and 102B, both communicating with a central server 104, which performs the comparison '919 Patent, Fig. 1A The detailed description explains that the server "can make a final determination... based on data and files received from at least two edge devices 102" '919 Patent, col. 9:1-4 This may suggest a structured, server-centric corroboration process rather than an ad-hoc use of data.
The Term: "multi-headed second convolutional neural network separate from the first" (from '014 Patent, Claim 1)
Context and Importance: This term defines the core technical architecture of the claimed invention. Infringement will depend on whether the accused "ClearLane" system employs this specific two-network structure. The complaint's allegations are based on marketing materials describing "advanced algorithms," which may not map directly to the specific architecture claimed.
Intrinsic Evidence for Interpretation:
- Evidence for a Broader Interpretation: The specification does not appear to offer significant support for a broad reading; the claim language itself is highly specific. A defendant might argue for equivalence with a single, multi-task neural network, but the claim's explicit "separate from the first" language presents a high bar.
- Evidence for a Narrower Interpretation: The claim's language is precise, requiring two distinct networks. The specification reinforces this separation by describing a "first worker" for vehicle detection and a "second worker" for lane detection, implying parallel but distinct processes '014 Patent, Fig. 7 '014 Patent, col. 26:50-54 The description of the second network as "multi-headed" with different heads trained for different lane types further specifies its unique structure '014 Patent, Fig. 9 '014 Patent, col. 33:1-4
VI. Other Allegations
- Indirect Infringement: The complaint alleges that Defendants induce infringement by providing the ClearLane system to customers, such as the New York MTA, and encouraging its use through marketing, user manuals, and technical support Compl. ¶179 Compl. ¶193 It also alleges contributory infringement by offering for sale components for use in the infringing system Compl. ¶179
- Willful Infringement: Willfulness is alleged based on Defendants' knowledge of the patents since at least the filing of the original complaint Compl. ¶180 Compl. ¶194 The complaint also asserts Defendants "knew, should have known, or was willfully blind" to the patents' existence due to being direct competitors Compl. ¶180 The extensive allegations of trade secret misappropriation, such as Defendants allegedly seeking Plaintiff's investor deck to "see what we can add to the model," may be used to argue a deliberate intent to copy Plaintiff's technology, which could support the willfulness claim Compl. ¶160
VII. Analyst's Conclusion: Key Questions for the Case
1. Architectural Correspondence: A primary technical question will be whether the accused "ClearLane" system's software architecture mirrors the specific two-network structure recited in Claim 1 of the '014 Patent. The case will likely require discovery beyond marketing materials to determine if the system actually employs a "first convolutional neural network" for vehicles that is "separate from" a "multi-headed second convolutional neural network" for lanes, or if it uses a different architecture, such as a single multi-task model.
2. Methodological Practice: For the '919 Patent, a central issue will be whether the accused system, in operation, practices the full claimed method of server-side corroboration. The analysis will likely focus on what evidence demonstrates that the ClearLane server systematically confirms a violation by comparing data from a "first edge device" at one time with data from a "second edge device" at a later time as a required step, rather than using data from multiple buses in a more general or alternative manner.
3. Intent and Willfulness: Given the complaint's detailed allegations of trade secret misappropriation and "product espionage," a key question for willfulness and enhanced damages will be one of intent. The court will need to examine whether the alleged pre-suit conduct, such as obtaining and analyzing Plaintiff's confidential materials, demonstrates a deliberate and willful disregard for Plaintiff's intellectual property rights that extends to the asserted patents.