Is a
Patent attributes
Patent Applicant
Current Assignee
Patent Jurisdiction
Patent Number
Date of Patent
February 1, 2022
Patent Application Number
17341193
Date Filed
June 7, 2021
Patent Citations Received
Patent Primary Examiner
Patent abstract
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for processing network inputs using an attention neural network that has one or more sparse attention sub-layers. Each sparse attention sub-layer is configured to apply a sparse attention mechanism that attends differently for input positions that are in a first proper subset of the input positions in the input to the sub-layer than for positions that are not in the first proper subset.
Timeline
No Timeline data yet.
Further Resources
No Further Resources data yet.