Log in
Enquire now
Retentive Network

Retentive Network

The Retentive network (RetNet) architecture is a foundational architecture for large language models proposed as an alternative to transformers.

OverviewStructured DataIssuesContributors

All edits by  Jude Gomila 

Edits on 31 Jul, 2023
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Infobox (+2 properties)
Infobox
Related Technology
Transformer
Transformer
Large language model
Large language model
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Infobox (+1 properties)
Infobox
GitHub URL
https://github.com/microsoft/unilm/tree/master/retnet
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Infobox (+1 properties)
Infobox
Official Website
https://thegenerality.com/agi/research.html
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Infobox (+1 properties)
Infobox
Published Date
July 25, 2023
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Infobox (+1 properties)
Infobox
Date Invented
July 25, 2023
0
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Description (+125/-13 characters)
Topic thumbnail

Retentive Network

AI technology

Retentive Network (RETNET) as a foundational architecture for large language models as an alternative to transformer models.

Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Infobox (+4 properties)
Infobox
Also Known As
RetNet0
Created/Discovered by
Tsinghua University
Tsinghua University
0
Microsoft Research
Microsoft Research
0
‌
Li Dong
0
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Infobox
Created/Discovered by
‌
Yutao Sun
0
Creator
‌
Yutao Sun
0
Jude Gomila profile picture
Jude Gomila
edited on 31 Jul, 2023
Edits made to:
Infobox (+1 properties)
Infobox
Created/Discovered by
‌
Yutao Sun
Edits on 24 Jul, 2023
Jude Gomila profile picture
Jude Gomila
edited on 24 Jul, 2023
Edits made to:
Infobox (+1 properties)
Infobox
Official Website
https://arxiv.org/pdf/2307.08621.pdf
Jude Gomila profile picture
Jude Gomila
edited on 24 Jul, 2023
Edits made to:
Description (+13 characters)
Topic thumbnail

Retentive Network

AI technology

"Created via: Web app"
Jude Gomila profile picture
Jude Gomila
created this topic on 24 Jul, 2023
Edits made to:
Infobox (+1 properties)
Topic thumbnail

 Retentive Network

The Retentive network (RetNet) architecture is a foundational architecture for large language models proposed as an alternative to transformers.

Infobox
Is a
Technology
Technology

Find more entities like Retentive Network

Use the Golden Query Tool to find similar entities by any field in the Knowledge Graph, including industry, location, and more.
Open Query Tool
Access by API
Golden Query Tool
Golden logo

Company

  • Home
  • Press & Media
  • Blog
  • Careers
  • WE'RE HIRING

Products

  • Knowledge Graph
  • Query Tool
  • Data Requests
  • Knowledge Storage
  • API
  • Pricing
  • Enterprise
  • ChatGPT Plugin

Legal

  • Terms of Service
  • Enterprise Terms of Service
  • Privacy Policy

Help

  • Help center
  • API Documentation
  • Contact Us