Awesome Generative AI
A curated list of Generative AI projects, tools, artworks, and models
Repository Introduction
Welcome to our Awesome List of Generative AI resources! This repository is a curated collection of references in the dynamic field of Generative AI, equipped with various sources such as academic papers, technical articles, online courses, tutorials, and software.
Structure
-
Sections: Each section represents a different Generative AI-related category (e.g., LLMs, prompt engineering, image synthesis, educational resources, etc.). The Inboxes are the more general references of a category. When a new category emerges, it becomes a specific subsection.
-
References within sections: Inside each section, references are listed in reverse chronological order, with the most recent one at the top. This order signifies the ever-evolving landscape of Generative AI, keeping you up-to-date with the latest developments.
This repository is designed to offer you the most recent advancements at your fingertips, allowing you to explore the depth of older resources at your own pace. It's regularly updated, ensuring you're always on track with the rapidly progressing world of Generative AI.
Contribute to our Repository
Your contributions are welcome and greatly appreciated! If you have a valuable resource that you believe should be on this list, or if you see any outdated information, please make a Pull Request. This will help us maintain the quality and relevance of our Awesome List.
Follow this roadmap, keep learning, and enjoy your journey through Generative AI!
Generative AI Area
Generative AI history, timelines, maps, and definitions
-
Timeline of AI forecasts - AI Digest
- [š„š„š„] Generative AI in a nutshell: a map with the most common Generative AI' concepts by Henrik Kniberg Youtube Video explaining the map
-
60+ Generative AIĀ Terms You Must Know By Heart: by Analytics Vidhya
-
The Four Wars of the AI Stack (Dec 2023 Recap): "recap of top items for the AI Engineer from Dec 2023" ("The Data Wars, The War of the GPU Rich/Poor, The Multimodality War, The RAG/Ops War")
-
GenAI Prism Infographic by Brian Solis: A Framework for Collaborating with Generative AI
-
LLM Visualization
-
[2310.04438] A Brief History of Prompt: Leveraging Language Models: the paper presents an exploration of the evolution of prompt engineering. The author, Golam Md Muktadir, extensively used ChatGPT for content generation
-
An AI Engineerās Guide to Machine Learning and Generative AI | by ai geek (wishesh) | Oct, 2023 | Medium
-
Emerging Trends in Generative AI Research: A Selection of Recent Papers
-
The architecture of today's LLM applications - The GitHub Blog
- [š„š„š„] [2310.07127] An HCI-Centric Survey and Taxonomy of Human-Generative-AI Interactions: "a survey of 154 papers, providing a novel taxonomy and analysis of Human-GenAI Interactions from both human and Gen-AI perspectives".
-
The Building Blocks of Generative AI | by Jonathan Shriftman | Medium
- [š„] Generative AI exists because of the transformer: a visual story by Financial Times
-
Early days of AI - by Elad Gil: thoughts about AI as "an entirely new era and discontinuity from the past"
-
The Next Token of Progress: 4 Unlocks on the Generative AI Horizon | Andreessen Horowitz
-
[2309.07930] Generative AI: discusses a model-, system-, and application-level view on generative AI.
-
The state of AI in 2023: Generative AIās breakout year | McKinsey
-
A jargon-free explanation of how AI large language models work | Ars Technica
-
The Generative AI Revolution: Exploring the Current Landscape | by Towards AI Editorial Team | Jun, 2023 | Towards AI
-
The Story of AI Winters and What it Teaches Us Today
-
There Would Have Been No LLMs Without This (episode#3 in the History series): timeline of LLMs by Turing Post
-
The Next Token of Progress: 4 Unlocks on the Generative AI Horizon | Andreessen Horowitz: critical innovations on the horizon: steering, memory, ability to use tools, and multimodality
-
The economic potential of generative AI: The next productivity frontier: report by McKinsey Jun 2023
-
A survey of Generative AI Applications | arxiv: "this survey aims to serve as a valuable resource for researchers and practitioners to navigate the rapidly expanding landscape of generative AI"
-
Paper Digest - ChatGPT: Recent Papers on ChatGPT
-
AI Index Report 2023 ā Artificial Intelligence Index: report that measures trends in AI written by the Human-Centered Artificial Intelligence from Stanford University
-
A Survey of Large Language Models: paper that summarizes the evolution of language models, with a focus on LLMs, discussing their advances, techniques, and impact on AI development and usage
-
The Generative AI Timeline: post in Linkedin by David Foster
-
Who Owns the Generative AI Platform? | Andreessen Horowitz: this article discusses the generative AI market and presents an interesting technology stack of the area
-
A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT | arxiv
- [š„š„] Toward General Design Principles for Generative AI Applications: this paper presents a set of seven principles for the design of generative AI applications
- [š„] The landscape of generative AI landscape reports | by Ramsri Goutham | Jan, 2023 | Medium: a meta report on the reports published by 9 venture capital firms
-
Generative AI with Cohere: Part 1 - Model Prompting: overview of Generative AI by Cohere AI
-
Generative AI with Cohere: Part 2 - Use Case Ideation: a list of Generative AI use cases by Cohere AI
-
Large Language Models and Where to Use Them: Part 1: a list of LLM use cases by Cohere AI
-
Large Language Models and Where to Use Them: Part 2
-
What's the big deal with Generative AI? Is it the future or the present?: summarization of the area of Generative AI by Cohere AI
-
Timeline of AI and language models: LLM timeline organized by Dr Alan D. Thompson from Life Architect
-
A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPT | arxiv
-
A Review of Generative AI from Historical Perspectives: paper by Dipankar Dasgupta, Deepak Venugopal and Kishor Datta Gupta
-
Matt Shumer on Twitter: "The definitive AI market map Twitter thread": "The definitive AI market map Twitter thread"
- [š„] Base11 Research - generative-ai: report about Generative AI produced by the investment firm Base10
-
Engines of Wow: AI Art Comes of Age ā Steve Murch
-
AI exploded on the scene at the end of 2022 / Twitter: categories for analyzing tools of Generative AI
- [š„š„š„] Mapping the Generative AI landscape | Antler
- [š„š„š„] AI Timeline: A history of text-to-image ML models by Fabian Mosele
-
AI-Generated Art: From Text to Images & Beyond Examples
-
1 week of Stable Diffusion | multimodal.art
Ethics, Philosophical questions and Discussions about Generative AI
Critical Views about Generative AI
-
When Will the GenAI Bubble Burst? - by Gary Marcus
-
Nightshade, the tool that āpoisonsā data, gives artists a fighting chance against AI | TechCrunch
-
How AI Fails Us | Edmond & Lily Safra Center for Ethics
-
Generative AI Has a Visual Plagiarism Problem - IEEE Spectrum: "Experiments with Midjourney and DALL-E 3 show a copyright minefield"
-
[2308.03762] GPT-4 Can't Reason: "despite the genuinely impressive improvement, there are good reasons to be highly skeptical of GPT-4's ability to reason"
-
Risk and Harm: Unpacking Ideologies in the AI Discourse | Proceedings of the 5th International Conference on Conversational User Interfaces
-
[2305.18654] Faith and Fate: Limits of Transformers on Compositionality
-
[2210.02667] A Human Rights-Based Approach to Responsible AI
-
On the Dangers of Stochastic Parrots | Proceedings of the 2021 ACM Conference on Fairness, Accountability, and Transparency
-
This new data poisoning tool lets artists fight back against generative AI | MIT Technology Review
-
The Short-Term Effects of Generative Artificial Intelligence on Employment: Evidence from an Online Labor Market by Xiang Hui, Oren Reshef, Luofeng Zhou :: SSRN
-
AI in Education Group Meeting Notes - Google Docs
-
Syllabi Policies for AI Generative Tools - Google Docs
-
Five takeaways from UKās AI safety summit at Bletchley Park | Artificial intelligence (AI) | The Guardian
-
Frontier AI: capabilities and risks ā discussion paper - GOV.UK
-
AI Safety Summit Policy Updates | AISS 2023
-
Responsible enterprise decisions with knowledge-enriched generative AI | Deloitte Netherlands
-
[2310.13149] Understanding Generative AI in Art: An Interview Study with Artists on G-AI from an HCI Perspective
-
[2309.12338] Artificial Intelligence and Aesthetic Judgment: "as generative AI influences contemporary aesthetic judgment we outline some of the pitfalls and traps in attempting to scrutinize what AI generated media means"
-
AI Worship | Marginal REVOLUTION
-
Artificial intelligence technology behind ChatGPT was built in Iowa ā with a lot of water | AP News
-
ChatGPT is fun, but not an author | Science
-
Behind the AI boom, an army of overseas workers in ādigital sweatshopsā | The Washington Post: Scale AIās Remotasks workers in the Philippines cry foul over low pay
-
Itās Not Intelligent If It Always Halts: A Critical Perspective on Current Approaches to AGI | Life Is Computation
-
The human costs of the AI boom | TechCrunch
-
AI Scams, Spam, Hacking, Are Ruining the Internet
-
The ChatGPT revolution is another tech fantasy
-
Why AI Will Save the World | Andreessen Horowitz
-
Hollywood studios proposed AI contract that would give them likeness rights āfor the rest of eternityā - The Verge
-
The shady world of Brave selling copyrighted data for AI training
-
Inside the AI Factory: the humans that make tech seem human - The Verge
-
Why transformative artificial intelligence is really, really hard to achieve
-
AI and the automation of work ā Benedict Evans
-
Yuval Noah Harari argues that AI has hacked the operating system of human civilisation
-
Generative AI Takes Stereotypes and Bias From Bad to Worse
-
Governance of superintelligence by OpenAI
-
AIAAIC - AIAAIC Repository: "The independent, open, public interest resource detailing incidents and controversies driven by and relating to artificial intelligence, algorithms, and automation"
-
Just Calm Down About GPT-4 Already - IEEE Spectrum
-
Pause Giant AI Experiments: An Open Letter - Future of Life Institute
-
"OpenAI released plugins for ChatGPT": tweet from @thealexbanks with a list of reflections about the impact of ChatGPT plugins
-
Is a socially fair Artificial Intelligence possible? | Uma InteligĆŖncia Artificial socialmente justa Ć© possĆvel?: post in Portuguese by H.D. Mabuse
-
Noam Chomsky on ChatGPT: It's "Basically High-Tech Plagiarism" and "a Way of Avoiding Learning" | Open Culture
-
Despite Their Feats, Large Language Models Still Haven't Contributed to Linguistics | Towards Data Science
-
Will ChatGPT Kill the Student Essay? | The Atlantic
-
What ChatGPT and generative AI mean for science | Nature
-
ChatGPT Is a Bullshit Generator Waging Class War
-
Some thoughts about generative AI and the future of education ā Mark Carrigan
-
Educator Considerations for ChatGPT - OpenAI API
-
Stable Diffusion Frivolous Ā·Ā Because lawsuits based on ignorance deserve a response.: a community response for the "Stable Diffusion litigation"
-
Stable Diffusion litigation Ā·Ā Joseph Saveri Law FirmĀ & Matthew Butterick
-
Generative Language Models and Automated Influence Operations: Emerging Threats and Potential Mitigations | OpenAI
-
Abstracts written by ChatGPT fool scientists
-
When Machines Change Art | Aaron Hertzmannās blog
-
The Dark Risk of Large Language Models | WIRED UK
-
ChatGPT, DALL-E 2 and the collapse of the creative process
-
What AI-Generated Art Really Means for Human Creativity | WIRED
-
Forecasting Potential Misuses of Language Models for Disinformation Campaignsāand How to Reduce Risk
-
The Dark Side of AI Art: 4 Potential Issues With the Growing Trend
-
Armed With ChatGPT, Cybercriminals Build Malware And Plot Fake Girl Bots
-
ChatGPT And The Mass Production Of Office Work - Farsight
-
The Danger Of ChatGPT Nobody Talks About | by Jacob Ferus | Dec, 2022 | Medium
-
Mind Control in the Metaverse. If weāve learned anything aboutā¦ | by Louis Rosenberg | Predict | Dec, 2022 | Medium
-
The Brilliance and Weirdness of ChatGPT - The New York Times
-
Como o texto gerado por InteligĆŖncia Artificial estĆ” envenenando a Internet - MIT Technology Review
-
O ChatGPT Ć© o momento āJurassic Parkā da inteligĆŖncia artificial - NeoFeed
-
Por favor, mais racionalidade e menos frenesi em relaĆ§Ć£o ao chatGPT (Parte 1 de 2) | by Cezar Taurion | Dec, 2022 | Medium
-
E se estivermos usando uma IA pseudocientĆfica? - Diogo Cortiz
-
As limitaƧƵes da sensaĆ§Ć£o tecnolĆ³gica de 2023: o ChatGPT | IAgora? | Ćpoca NEGĆCIOS
-
7 Revealing Ways AIs Fail - IEEE Spectrum
Generative AI Processes and Artifacts
More info
Generative AI is a branch of artificial intelligence that focuses on creating new data based on patterns learned from existing data. Here's a step-by-step explanation of the process:
-
Starting with Data: Every Generative AI process begins with data. This can be in various forms such as text, images, sounds, or other datasets. This data serves as the foundational material that the AI uses to recognize and understand patterns.
-
Training the AI: With the data in hand, the next step is 'training'. During this phase, the AI processes the data multiple times to learn and internalize the patterns present. The outcome of this stage is a 'model', which acts like a digital representation of the knowledge derived from the data.
-
Fine-Tuning: At times, there's a need for the AI to focus on specific nuances or characteristics. In such cases, an additional set of data is used to 'fine-tune' the already trained model, enhancing its capabilities in the desired direction.
-
Using the Model: After training, the model is prepared to make inferences, which means using its acquired knowledge to process new data and come up with relevant outputs. This inference process can be executed locally on a machine or can be accessed remotely through an 'API'. The choice between local execution and API access often depends on factors like computational resources, application needs, and user preferences. Whether locally or via an API, the goal is to leverage the model's capabilities to derive meaningful results from new data inputs.
-
Generating New Data: With the model set up, the AI can now produce or 'generate' new data. By giving the AI certain 'input parameters' or guidelines, it returns with 'generated output', which is the newly created content.
-
Applications: The output generated by the AI can be incorporated into a range of applications, be it websites, mobile apps, or other digital platforms. The 'interface' refers to the user-facing portion of these applications, enabling users to interact with and benefit from the AI's capabilities.
In essence, Generative AI is about feeding an AI system vast amounts of data, training it to grasp underlying patterns, and then utilizing that trained knowledge to produce novel data. The potential applications and benefits of this technology are vast and continue to grow as the field evolves.
Courses and Educational Materials
-
DataCamp's Become a Generative AI Developer series: 9 code-alongs on building chatbots using LangChain and the OpenAI and Pinecone APIs, and working with the Hugging Face ecosystem. Free, for a limited time only.
-
rasbt/LLMs-from-scratch: Implementing a ChatGPT-like LLM from scratch, step by step
-
Introduction to Generative AI | SqillPlan: introduction to Generative AI, including models such as GANs, Variational Autoencoders, Autoregressive Models, and their applications, evaluation, ethics, and challenges
-
udlbook/udlbook: Understanding Deep Learning by Professor Simon J.D. Prince
-
Book: Understanding Deep Learning: website with the book draft and Google Colabs of the book by Simon J.D. Prince
-
List of Generative AI Learning resources from AWS and Google: list organized as a LinkedIn post by Ankit Agarwal
-
How AI chatbots like ChatGPT or Bard work ā visual explainer | The Guardian
- [š„š„] Generative AI for Beginners: introductory 12 lesson course by Microsoft
-
Introduction to Generative AI: series of Medium articles by Youssef Hosni
-
Animated AI: animations and instructional videos about neural networks
-
Deep Learning AI - Learn the fundamentals of generative AI for real-world applications: created in partnership with AWS, this course presents the fundamentals of how generative AI works and how to deploy it in real-world applications.
-
Google Cloud Skills Boost - Introduction to Generative AI: an introductory level microlearning course covering Google Tools aimed at explaining what Generative AI is, how it is used, and how it differs from traditional machine learning methods.
-
Google Cloud Skills Boost: Generative AI learning path: curated content on Generative AI "from the fundamentals of Large Language Models to how to create and deploy generative AI solutions on Google Cloud"
-
AI for Industrial Design: "students at the National University of Singapore explore AIās capability for design in a semester course and share what they learned. Directed by Donn Koh at the Division of Industrial Design, NUS."
-
Let Us Show You How GPT Works ā Using Jane Austen - The New York Times
- [š„š„š„] ChatGPT Prompt Engineering for Developers - DeepLearning.AI: short course taught by Isa Fulford (OpenAI) and Andrew Ng (DeepLearning.AI) that provide best practices for prompt engineering
- [š„š„š„] DAIR.AI: Democratizing Artificial Intelligence Research, Education, and Technologies
-
Welcome to the š¤ Deep Reinforcement Learning Course: a Hugging Face Course on Deep Reinforcement Learning
-
Crash course in AI art generation by PromptHero: paid ($99) course focused on prompt engineering
-
Visual intuition for diffusion models and AI art. #stablediffusionart #aiart #aiartwork #aiartcommunity
-
The Illustrated Stable Diffusion by Jay Alammar: "gentle introduction [on] how Stable Diffusion works"
- [š„]johnowhitaker/tglcourse: The Generative Landscape - a course on generative modelling (currently unfinished)
-
Words are Images | BustBright - Machine Learning Art: 7-week Online class starting October 24th, 2022 by Derrick Schultz
-
Grokking Stable Diffusion.ipynb - Colaboratory - Part 1: notebook by @johnowhitaker exploring Stable Diffusion details
-
Grokking Stable Diffusion: Textual Inversion.ipynb - Colaboratory - Part 2: sequel to Grokking Stable Diffusion by @johnowhitaker that focus on Text Inversion
-
GitHub - johnowhitaker/aiaiart: Course content and resources for the AIAIART course
-
Implementation/tutorial of stable diffusion with side-by-side notes by labml.ai | Twitter
-
Practical Deep Learning for Coders 2023 - Part II: continuation of the course focusing on the implementation of Stable Diffusion from scratch.
-
Practical Deep Learning for Coders 2022 - Part I: "free course designed for people with some coding experience who want to learn how to apply deep learning and machine learning to practical problems" by Jeremy Howard
Human-AI Interaction
Papers Collection
-
VocalReplica: AI-Powered Vocal and Instrumental Isolation for Your Favorite Tracks
-
LangMagic: Learn languages from native content.
-
Persuva: Persuva is the AI-driven platform to create persuasive, high-converting ad copy at scale.
-
Dittto.ai: Fix your hero copy with an AI trained on top SaaS websites.
-
SEOByAI: Rank Faster on Google with FREE AI SEO Tools
-
SinglebaseCloud: AI-powered backend platform with Vector DB, DocumentDB, Auth, and more to speed up app development.
-
TrollyAI: Create professional SEO articles, 2x faster
-
WebscrapeAI: Scrape any website without code using AI
-
Architecture Helper: Analyze any building architecture, and generate your own custom styles, in seconds.
-
AI-Flow: Connect multiple AI models easily
-
Code to Flow: Visualize, Analyze, and Understand Your Code flow. Turn Code into Interactive Flowcharts with AI. Simplify Complex Logic Instantly.
-
Recast Studio: AI-powered podcast marketing assistant.
-
Clipwing: A tool for cutting long videos into dozens of short clips.
-
Tailor: Get a daily podcast and newsletter, created for you by an AI
-
ZZZ Code AI: AI-powered free website to get any programming question answered or code generated.
-
Scribble Diffusion: turn your sketch into a refined image using AI
-
Paint by Text: Edit your photos using written instructions, with the help of an AI.
-
Scenario AI: AI-generated game assets
-
AnimalAI: custom AI-generated animal portraits (profits are directed to various wildlife conservation organizations)
-
starryai: AI Art Generator App - AI Art Maker
-
ProsePainter: an interactive tool to "paint with words." It incorporates guidable text-to-image generation into a traditional digital painting interface
-
ProsePainter: Image + Sketching Interface + CLIP! - YouTube
-
Cocreator AI: creative computer agent (in wait list)
-
Runway ML: AI video creation suite
-
Hotpot.ai - Hotpot.ai: set of AI Tools to post-process images
-
Toonify yourself by Justin Pinkney: turn a human face into a cartoon
-
deepart.io: a online tool for applying style transfer
-
Artbreeder: web-based tool to generate images by breeding existing images
-
Ostagram.ru: image style transfer plataform
-
cleanup.pictures: remove objects, people, text and defects from any picture for free
-
remove.bg: remove background from images
-
Quick, Draw!: can a neural network learn to recognize doodling? A game to help NL by adding users drawing
-
Nekton.ai: automate your workflows with AI
-
Documind.chat: Chat with PDF using AI. Documind is a powerful chat with pdf tool that lets you ask questions from your pdf documents.
-
Snowpixel: Generate Images/Videos/Animations/Audio/Music/3D Objects with Text and/or Image. Upload your own data to create custom models.
-
Chatpdf.so: Talk to PDF using GPT4 AI. Chatpdf.so is a chatpdf tool that lets you do question answering on your pdf documents.
-
Yona.ai: Create deeply personalized AI chatbots from your own conversations, your stories, your data. You can harness the power of your chat history to build an AI companion for a nostalgic trip down memory lane, whimsical fantasies, or any other unique purpose.
-
Voicesphere: Chat with your documents to get intelligent, context specific answers.
Text
Small Language Models
Large Language Models (LLMs)
-
stanfordnlp/dspy: DSPy: The framework for programming ā not prompting ā foundation models
-
Groq: service focused on fast inference speed, providing API access to Llama 2 70B-4K and Mixtral 8x7B-32K
- [š„š„š„] LLMLingua: Designing a Language for LLMs via Prompt Compression
-
Floom AI gateway and marketplace for developers, enables streamlined integration of AI features into products
-
rasbt/LLMs-from-scratch: Implementing a ChatGPT-like LLM from scratch, step by step
-
GoogleCloudPlatform/generative-ai: Sample code and notebooks for Generative AI on Google Cloud
-
LLM Visualization
-
Automatic Hallucination detection with SelfCheckGPT NLI
-
StreamingLLM gives language models unlimited context: giving language models unlimited context
-
iusztinpaul/hands-on-llms: learn about LLMs, LLMOps, and vector DBs for free by designing, training, and deploying a real-time financial advisor LLM system ~ š“š°š¶š³š¤š¦ š¤š°š„š¦ + š·šŖš„š¦š° & š³š¦š¢š„šŖšÆšØ š®š¢šµš¦š³šŖš¢šš“
-
Practical Tips for Finetuning LLMs Using LoRA (Low-Rank Adaptation)
-
Poe: a platform that lets people ask questions, get instant answers, and have back-and-forth conversations with a wide variety of AI-powered bots
-
[2311.01555] Instruction Distillation Makes Large Language Models Efficient Zero-shot Rankers
- [š„š„] State of LLM Apps 2023 Ā· Streamlit
-
The architecture of today's LLM applications - The GitHub Blog
-
Demystifying LLMs: How they can do things they weren't trained to do - The GitHub Blog
-
How AI chatbots like ChatGPT or Bard work ā visual explainer | The Guardian
-
cpacker/MemGPT: teaching LLMs memory management for unbounded context [demo page] [arxiv]
-
[2307.10169] Challenges and Applications of Large Language Models: a systematic set of open problems and application successes of LLM area
-
Related resources from around the web | OpenAI Cookbook: tools and papers for improving outputs from GPT
- [š„š„š„] Patterns for Building LLM-based Systems & Products: "practical patterns for integrating large language models (LLMs) into systems & products" by Eugene Yan
-
Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Model
-
[2309.06794] Cognitive Mirage: A Review of Hallucinations in Large Language Models
-
Generative AI for Strategy & Innovation: an experiment about management theories with ChatGPT by Harvard Business Review Italia
-
The TextFX project: "AI-powered tools for rappers, writers and wordsmiths" (partnership between Lupe Fiasco and Google)
-
A jargon-free explanation of how AI large language models work | Ars Technica
- [š„š„š„] What We Know About LLMs (Primer)
-
A simple guide to fine-tuning Llama 2 | Brev docs
-
microsoft/semantic-kernel: integrate cutting-edge LLM technology quickly and easily into your apps
-
CoPrompt: platform for teams to use ChatGPT together
- [š„š„š„] Emerging Architectures for LLM Applications | Andreessen Horowitz: "a reference architecture for the emerging LLM app stack"
-
Advanced Guide to ChatGPT: guide by Neatprompts.com
-
Falcon LLM - Home: a foundational large language model (LLM) with 40 billion parameters trained on one trillion tokens shared by Technology Innovation Institute from Abu Dhabi
- [š„š„š„] The Hugging Face Open LLM Leaderboard: "the š¤ Open LLM Leaderboard aims to track, rank and evaluate LLMs and chatbots as they are released"
-
google/BIG-bench: "a collaborative benchmark intended to probe large language models and extrapolate their future capabilities"
-
togethercomputer/OpenChatKit: provides an open-source base to create both specialized and general purpose chatbots for various applications
-
Paper Digest - ChatGPT: Recent Papers on ChatGPT
-
Let Us Show You How GPT Works ā Using Jane Austen - The New York Times
-
Search-in-the-Chain: Towards Accurate, Credible and Traceable Large Language Models for Knowledge-intensive Tasks | arxiv: "a novel framework called Search-in-the-Chain (SearChain) to improve the accuracy, credibility and traceability of LLM-generated content for multi-hop question answering"
- [š„š„š„] Mooler0410/LLMsPracticalGuide: list of practical guide resources of LLMs based on the paper Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and Beyond
-
hpcaitech/ColossalAI: Making large AI models cheaper, faster and more accessible
-
microsoft/LoRA: Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"s
-
kyrolabs/awesome-langchain: š Awesome list of tools and project with the awesome LangChain framework
-
Stability AI Launches the First of its StableLM Suite of Language Models ā Stability AI
-
Free Dolly | The Databricks Blog: open source, instruction-following LLM, fine-tuned on a human-generated instruction dataset licensed for research and commercial use
-
Summary of ChatGPT/GPT-4 Research and Perspective Towards the Future of Large Language Models: paper with "a comprehensive survey of ChatGPT and GPT-4 and their prospective applications across diverse domains"
-
lm-sys/FastChat: The release repo for "Vicuna: An Open Chatbot Impressing GPT-4" [demo]
- [š„š„š„] oobabooga/text-generation-webui: a gradio web UI for running Large Language Models like GPT-J 6B, OPT, GALACTICA, LLaMA, and Pygmalion
-
Why LLaMa Is A Big Deal | Hackaday: post that discusses the impact of LLaMa and Alpaca in popularizing LLMs and even using them in small hardware devices
-
logspace-ai/langflow: a UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows
-
More than you've asked for: A Comprehensive Analysis of Novel Prompt Injection Threats to Application-Integrated Large Language Models: paper on LLM Security
-
Cohere AI: a way to integrate state-of-the-art language models to applications
-
Langchain for paper summarization: using langchain to build a app for paper summarization
-
Red-Teaming Large Language Models | Hugging Faces: strategies for testing LLMs against jailbreaks and attacks
-
hwchase17/langchain: "building applications with LLMs through composability"
-
Top Large Language Models (LLMs) in 2023 | MarkTechPost: list with large language models from diverse companies
-
Godly: Instant context for GPT3
-
GPTZero: "Detect AI Plagiarism. Accurately"
-
GPT-3 Apps: GPT-3 Powered Micro Products (ex: cat namer, poet pocket, summarize)
-
Inside language models (from GPT-3 to PaLM) ā Dr Alan D. Thompson ā Life Architect
-
Google AI Blog: Pathways Language Model (PaLM): Scaling to 540 Billion Parameters for Breakthrough Performance
-
DeepMind says its new language model can beat others 25 times its size | MIT Technology Review
-
Integrated AI: How to talk to AI for free using nine platforms (Megatron, GPT-3, GPT-J, Wudao, J1..) - YouTube by Dr Alan D. Thompson. The following references came from this video description
-
Haystack: framework for building applications with LLMs and Transformers (e.g. agents, semantic search, question-answering)
-
SolidUI: AI-generated visualization prototyping and editing platform, support 2D, 3D models, combined with LLM(Large Language Model) for quick editing.
Prompt Engineering
Prompt Optimizers
- [š„š„š„] stanfordnlp/dspy: DSPy: The framework for programming ā not prompting ā foundation models
-
vaibkumr/prompt-optimizer: Minimize LLM token complexity to save API costs and model computations.
-
PromptPerfect: "Optimize Your Prompts to Perfection"
- [š„š„š„] LLMLingua: Designing a Language for LLMs via Prompt Compression
Prompt Engineering for Text-to-text
Prompt Engineering for Text-to-image
Mamba
Running LLMs Locally
-
PowerInfer: a high-speed inference engine for deploying LLMs locally
- [š„š„] Ollama: run Llama 2, Code Llama, and other models locally
-
GPT4All: A free-to-use, locally running, privacy-aware chatbot. No GPU or internet required.
-
LM Studio: Discover, download, and run local LLMs
-
ggerganov/llama.cpp: Port of Facebook's LLaMA model in C/C++
Function Calling
GPTs and Assistant API
Retrieval-Augmented Generation (RAG)
Embeddings and Semantic Search
Autonomous LLM Agents
-
Practices for Governing Agentic AI Systems: paper by OpenAI that offers a set of practices for keeping agentsā operations safe and accountable.
-
[2312.05230] Language Models, Agent Models, and World Models: The LAW for Machine Reasoning and Planning
-
[2309.02427] Cognitive Architectures for Language Agents: "we draw on the rich history of cognitive science and symbolic artificial intelligence to propose Cognitive Architectures for Language Agents (CoALA)"
-
[2309.07864] The Rise and Potential of Large Language Model Based Agents: A Survey
-
[2310.01444] Adapting LLM Agents Through Communication
-
[2309.17288] AutoAgents: A Framework for Automatic Agent Generation
-
Exploring Multi-Persona Prompting for Better Outputs: "method of prompt engineering that instructs the LLM to summon multiple personas and have them work together to solve a task"
-
Conceptual Framework for Autonomous Cognitive Entities: a paper that "introduces the Autonomous Cognitive Entity (ACE) model, a novel framework for a cognitive architecture, enabling machines and software agents to operate more independently"
-
Mindstorms in Natural Language-Based Societies of Mind: a paper that evaluates the natural language-based societies of mind (NLSOMs), leveraging mindstorms in them to solve some practical AI tasks
-
AutoGen | Microsoft: multi-agent conversation framework as a high-level abstraction by Microsoft [github]
-
OpenBMB/ChatDev: create customized software using natural language idea (through llm-powered multi-agent collaboration)
-
a16z-infra/ai-town: A MIT-licensed, deployable starter kit for building and customizing your own version of AI town - a virtual town where AI characters live, chat and socialize.
-
AI Town: a virtual town where AI characters live, chat and socialize.
-
joonspk-research/generative_agents - Generative Agents: code for interactive simulacra of human behavior [arxiv]
-
AgentBench: Evaluating LLMs as Agents: Hugging Face paper page on a benchmark to evaluate LLMs agents
-
geekan/MetaGPT: the multi-agent framework that, give one line requirement, return PRD, design, tasks, repo
-
GPT Researcher: AI agents for insights and research
-
Multi-agent Simulation by Jim Fan on Twitter: "The next frontier of emergent intelligence will be multi-agent simulation: a crowd of AI characters carry out their daily lives through complex social interactions"
-
Introducing AACP | SuperAGI: agent to agent communication protocol
-
BrainstormGPT: AI multi-agent problem solving
-
ChatArena: building multi-agent environments for LLMs
- [š„š„š„] LLM Powered Autonomous Agents | Lil'Log: the LLM agents learning notes by Lilian Weng
-
Vercel for AI agents: "help developers to build, deploy, and monitor AI agents, focusing on specialized AI agents that build software for you - your personal software developers"
-
101dotxyz/GPTeam: "GPTeam uses GPT-4 to create multiple agents who collaborate to achieve predefined goals"
-
Fine-Tuner.ai: no code approach to build AI agents
-
AI Agent Basics: Letās Think Step By Step - by Jon Stokes
- [š„š„] Transformers Agent: provides a natural language API on top of Hugging Face's transformers library
-
AgentGPT: "assemble, configure, and deploy autonomous AI Agents in your browser"
-
yoheinakajima/babyagi: an AI-powered task management system that uses OpenAI and Pinecone APIs to create, prioritize, and execute tasks
-
Torantulino/Auto-GPT: "an experimental open-source attempt to make GPT-4 fully autonomous"
-
Generative Agents: Interactive Simulacra of Human Behavior: a paper that presents computational software agents that simulate believable human behavior
-
microsoft/JARVIS: JARVIS, a system to connect LLMs with ML community
-
HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace
Multi-agents
LLM Evaluation
LLMOps
-
Eden AI: provides a unique API connected to the AI engines
-
Dify: LLMOps platform for creating and operating AI-native apps based on GPT-4
-
LLM App: LLM App is a Python library that helps you build real-time AI-powered data pipelines with few lines of code.
AI Engineering
Attacks on LLMs
LangChain
ChatGPT
Text-related Generative Tools
-
whitead/paper-qa: "LLM Chain for answering questions from documents with citations"
-
Metaphor: search engine that "understands language ā in the form of prompts ā so you can say what you're looking for in all the expressive and creative ways"
Image
Image Synthesis
Inbox: Stable Diffusion
-
Complete guide to samplers in Stable Diffusion - FĆ©lix Sanz
-
Stable Diffusion Models: list of custom Stable Diffusion models
-
Stable Diffusion KLMC2 Animation.ipynb forked: fork by @DigThatData
-
Stable Diffusion KLMC2 Animation.ipynb: notebook by @RiversHaveWings to generate animation based on scripted prompts using a technique called KLMC2 discretization of underdamped Langevin dynamics
-
DETEXTIFY: A Python library to remove unwanted pseudo-text from images generated by your favorite generative AI models (Stable Diffusion, Midjourney, DALLĀ·E)
-
InvokeAI: Stable Diffusion Toolkit and application that runs Windows, Mac and Linux machines, and on GPU cards with as little as 4 GB or RAM
-
Stability.ai REST API Documentation: service provided by Stability.ai. DreamStudio authentication required to access this REST API
- [š„š„š„] SD GUIDE FOR ARTISTS AND NON-ARTISTS - Google Docs: a Google Docs with in-depth tips, tricks, tutorials and more related to Stable Diffusion
- [NEWS]Canva Adds a Free and Unlimited AI Text-to-Image Generator | PetaPixel
-
prompthero/midjourney-v4-diffusion Ā· Hugging Face: Stable Diffusion fine tuned on Midjourney v4 images, by PromptHero
-
CHARL-E: Run Stable Diffusion on your M1 Mac
-
The Illustrated Stable Diffusion: explained by Jay Alammar (Visualizing machine learning one concept at a time)
-
Img To Music a Hugging Face Space by fffiloni
-
Atlas KREA Stable Diffusion: An explorable map of KREA AI's Stable Diffusion Search Engine
-
TheLastBen/fast-stable-diffusion: fast-stable-diffusion, +25-50% speed increase + memory efficient + DreamBooth
-
NovelAI Improvements on Stable Diffusion | by NovelAI | Oct, 2022 | Medium
-
ashawkey/stable-dreamfusion: A pytorch implementation of text-to-3D dreamfusion, powered by stable diffusion.
- [š„š„š„] JoePenna/Dreambooth-Stable-Diffusion: Implementation of Dreambooth (https://arxiv.org/abs/2208.12242) with Stable Diffusion (tweaks focused on training faces)
- [š„š„š„] DreamBooth: fine tuning text-to-image diffusion models for subject-driven generation
- [š„] Arki's Stable Diffusion Guides
-
examples/stable-diffusion-finetuning at main Ā· LambdaLabsML/examples: Fine Tuning Stable Diffusion
-
lkwq007/stablediffusion-infinity: Outpainting with Stable Diffusion on an infinite canvas
- [š„š„š„] ML News Stable Diffusion Takes Over! (Open Source AI Art) by Yannic Kilcher - YouTube: video with examples, updates, and discussion about the impact of Stable Diffusion
-
Diffusion Models in Vision: A Survey | DeepAI: paper about the diffusion techniques which also discuss the relation with other generative deep learning models
-
ThereforeGames/txt2mask: Automatically create masks for Stable Diffusion inpainting using natural language
-
basujindal/stable-diffusion: Optimized Stable Diffusion modified to run on lower GPU VRAM
-
Stable WarpFusion v0.5 (restricted to patreons): conditioning video frames with Stable Diffusion by @devdef
-
nateraw/stable-diffusion-videos: Create videos with Stable Diffusion by exploring the latent space and morphing between text prompts
Web UI for Stable Diffusion via Google Colab
References Collection about Stable Diffusion
Hypertechniques
ControlNet
Textual Inversion
DreamBooth
Deforum
Image Upscaling
Image Restoration
-
sczhou/codeformer: face restoration algorithm for old photos and AI-generated faces
-
TencentARC/GFPGAN: GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration
Image Segmentation
Video and Animation
Audio and Music
Speech
Inbox: Text-to-speech (TTS) and avatars
Inbox: Speech-to-text (STT) and spoken content analysis
Games
Code and Programming
-
New study on coding behavior raises questions about impact of AI on software development ā GeekWire
-
CostGPT: Software Development Cost Calculator: "find the cost, time and the best tech stack for any kind of software, tools that you want to build using the power of AI"
-
codefuse-ai/Awesome-Code-LLM: a curated list of language modeling researches for code and related datasets.
-
tldraw/draw-a-ui: draw a mockup and generate HTML for it
-
deepseek-ai/DeepSeek-Coder: a tool that experiments the motto "let the code write itself"
-
Cody: AI coding assistant
-
Kombai: generate UI code per component from Figma
-
geekan/MetaGPT: the multi-agent framework that, give one line requirement, return PRD, design, tasks, repo
-
ZZZ Code AI: AI-powered free website to get any programming question answered or code generated.
-
Rapidpages: create React & Tailwind landing pages using AI
-
Teaching Programming in the Age of ChatGPT ā OāReilly
-
GPT Web App Generator: generates a webapp from a title, description, and other simple parameters
-
wolfia-app/gpt-code-search: search a codebase with natural language using AI
-
Dedicated File for Inbox for GenAI + Dev: a list for further analysis and organization of GenAI + dev references
-
e2b-dev/e2b: "Open-source platform for building AI-powered virtual software developers"
-
Metabob: Generative AI to improve and automate code reviews
-
gventuri/pandas-ai: Pandas AI is a Python library that integrates LLMs capabilities into Pandas, making dataframes conversational
-
A Systematic Evaluation of Large Language Models of Code: arxiv paper
-
pgosar/ChatGDB: "Harness the power of ChatGPT inside the GDB debugger"
-
The Impact of AI on Developer Productivity: Evidence from GitHub Copilot | arxiv
-
openai/openai-cookbook: Examples and guides for using the OpenAI API
-
Reduce costs when prompting using GPT
-
Co-Developer GPT engine - local r/w file access and execute actions from an OpenAI GPT
Multimodal
Multimodal Embedding Space
Datasets
-
Ego-Exo4D: a foundational dataset by Meta for research on video learning and multimodal perception Dataset Download
-
Carolina: General Corpus of Contemporary Brazilian Portuguese with provenance and typology information - Corpus Geral do PortuguĆŖs Brasileiro ContemporĆ¢neo
-
RedPajama-Data-v2 by Together AI: an open dataset with 30 trillion tokens for training Large Language Models
-
Have I Been Trained?: tool for searching 5.8 billion images used to train popular AI art models
-
laion-aesthetic-6pls: exploring 12 million of the 2.3 billion images used to train Stable Diffusion's image generator
-
CLIP retrieval for laion5B: CLIP retrieval using Laion5B. "It works by converting the text query to a CLIP embedding , then using that embedding to query a knn index of clip image embedddings".
-
rom1504/clip-retrieval: Easily compute CLIP embeddings and build a CLIP retrieval system with them
-
LAION: Large-scale Artificial Intelligence Open Network
-
gabolsgabs/DALI: a large Dataset of synchronised Audio, LyrIcs and vocal notes
Misc
People and works
Interesting Instagram Accounts, Posts and Reels
Interesting Youtube Channels
Interesting GitHub Repositories
Artists and Artworks
Galleries
-
Hannibal046/Awesome-LLM: Awesome-LLM: a curated list of Large Language Model
-
AlexChalakov/awesome-generative-ai-companies: a curated list of GŠµnerative AI companies, sorted by focus area and total fundraised amount
-
kyrolabs/awesome-langchain: š Awesome list of tools and project with the awesome LangChain framework
-
KangweiiLiu/Awesome_Audio-driven_Talking-Face-Generation: A curated list of resources of audio-driven talking face generation
- [š„] amrzv/awesome-colab-notebooks: Collection of google colaboratory notebooks for fast and easy experiments
- [š„š„š„] steven2358/awesome-generative-ai: A curated list of modern Generative Artificial Intelligence projects and services
- [š„š„š„] jonathandinu/awesome-ai-art: "A list of AI Art courses, tools, libraries, people, and places"
-
margaretmz/awesome-ai-art-design: An awesome list: AI for art and design.
-
toxtli/awesome-machine-learning-jupyter-notebooks-for-colab: A curated list of Machine Learning and Deep Learning tutorials in Jupyter Notebook format ready to run in Google Colaboratory
-
chaosreactor/awesome-generative-ai: An awesome list of low- and no-code generative AI resources
- [š„] altryne/awesome-ai-art-image-synthesis: A list of awesome tools, ideas, prompt engineering tools, colabs, models, and helpers for the prompt designer playing with aiArt and image synthesis. Covers Dalle2, MidJourney, StableDiffusion, and open source tools.
-
justinpinkney/awesome-pretrained-stylegan2: A collection of pre-trained StyleGAN 2 models to download
Bio experiments
-
fMRI-to-image: tweet by danberridge "The 'presented images' were shown to a group of humans. The 'reconstructed images' were the result of an fMRI output to Stable Diffusion. In other words, Stable Diffusion literally read people's minds."
Jobs in Generative AI
Improving Google Colab experience
-
fynk: AI powered contract management software
-
Taskbase: Virtual assistants packaged with AI powered software.
-
AI Wedding Toast: Generate a personalized wedding speech with AI
-
Interviews Chat: Your Personal Interview Prep & Copilot
-
Inline Help: Answer customer questions before they ask
-
LinkActions: AI Internal Links Assistant
-
Marblism: Generate a SaaS boilerplate from a prompt
-
SiteSpeakAI: Automate your customer support with AI
-
Room Reinvented: Transform your room effortlessly with Room Reinvented! Upload a photo and let AI create over 30 stunning interior styles. Elevate your space today.
-
FairyTailAI: Personalized bedtime story generator
-
PromptPal: Search for prompts and bots, then use them with your favourite AI. All in one place.
-
Never Jobless LinkedIn Message Generator: Maximize Your Interview Chances with AI-Powered LinkedIn Messaging.
-
Aispect: New way to experience events.
-
SiteGPT: Make AI your expert customer support agent.
-
PressPulse AI: Get personalized media coverage leads every morning.
-
GPTHelp.ai: ChatGPT for your website / AI customer support chatbot.
-
chaiNNer-org/chaiNNer: A node-based image processing and AI upscaling GUI that makes it easy to chain together complex processing tasks
-
BIRME: Bulk Image Resizing Made Easy 2.0 (Online & Free)
-
The Art of PNG Glitch
-
HashLips/hashlips_art_engine: tool used to create multiple different instances of artworks based on provided layers
-
Taplio: The all-in-one, AI-powered LinkedIn tool.
Dimension reduction techniques
Roadmaps, Tracks, Rails
Stargazers over time
Contribute
Contributions welcome! Read the contribution guidelines first.
License
To the extent possible under law, Filipe Calegario has waived all copyright and
related or neighboring rights to this work.