Research & Education

Awesome-Deep-Learning-Resources is a curated list of valuable deep learning resources compiled by Guillaume Chevalier. This repository serves as an excellent reference for anyone looking to learn, revisit, or deepen their understanding of deep learning topics. It meticulously lists online classes, books, posts, articles, practical resources, libraries, implementations, datasets, and mathematical theories related to deep learning. Each resource has been carefully reviewed by the curator, ensuring high quality and relevance. The collection is particularly useful for understanding trends, optimizing neural networks, and exploring advanced concepts like attention mechanisms and recurrent neural networks.

Awesome-ai-coding-tools is a comprehensive, curated list of AI-powered coding tools designed for developers, teams, and tech enthusiasts. This resource categorizes tools across various functionalities, including AI-first code editors, advanced code completion engines, intelligent coding agents, and tools for UI generation and app building. It also covers solutions for code review, refactoring, testing, and documentation. The list aims to help users discover and utilize AI in software engineering, offering insights into tools that enhance productivity, automate tasks, and streamline development workflows. Contributions are welcome, making it a community-driven and evolving resource.

Awesome-ai-residency is a curated list of AI Residency Programs, designed to help individuals navigate and explore various career development opportunities in the field of artificial intelligence. This resource compiles information on internships, bootcamps, and full-time residency programs offered by leading organizations and institutions across different years. Users can find details on application deadlines, program durations, and direct links to apply. The list is categorized by year and type, making it easy to discover relevant opportunities, from general AI residencies to specialized roles in areas like machine learning research, generative AI, and AI safety. It also includes links to articles, blogs, and Reddit/Quora discussions for further insights and preparation tips.

Upland BA Insight is an AI-powered enterprise search and AI enablement platform designed to enhance productivity and maximize AI investments. It addresses critical challenges in AI projects such as bad data, data exposure, limited visibility, and rigid AI frameworks by providing a flexible platform that connects to over 95 enterprise data sources. The platform offers intelligent web-like search, item-level security, semantic understanding, and conversational search with RAG enhancement. It also supports content enrichment, AI/ML models for personalized content, and environment flexibility, allowing users to choose their AI provider, LLM, search engine, and user interface. BA Insight aims to deliver the fastest time to value with fully scalable, out-of-the-box solutions.

PromptBox-AI Prompt Manager is an iOS mobile application designed to streamline the process of collecting, organizing, and managing AI prompts. Users can manually enter prompts, utilize a smart paste feature from the clipboard, and analyze URLs to extract prompt information. The app supports iCloud synchronization to keep prompts updated across devices. For advanced functionalities, PromptBox Pro offers unlimited collection, iCloud sync, and OCR capabilities, available through monthly or annual subscriptions. The tool emphasizes user privacy by not storing personal data on its servers and processing AI analysis data temporarily without permanent storage.

Bluedot is an invisible, privacy-first AI note taker designed for both online and in-person meetings. It captures, transcribes, and summarizes every conversation without a bot joining the call, ensuring a non-intrusive experience. The tool delivers highly accurate AI meeting notes, including technical terms, to-dos, abbreviations, and speaker identification, in over 100 languages. Bluedot works across any platform, including Zoom, Google Meet, Microsoft Teams, and even phone calls, with dedicated apps for web, desktop, and mobile. It also offers post-meeting automation, syncing notes, transcripts, and action items to CRMs, ATSs, and other tools via its API, making it a shared memory for teams of all sizes.

StyleGAN-T offers training code for advanced text-to-image synthesis, leveraging the power of GANs for rapid, large-scale image generation. This tool is designed for researchers and developers who want to train their own models, providing the necessary framework and scripts. It supports both unconditional and conditional datasets, with recommendations for zip datasets for small-scale experiments and webdatasets for larger scales (over 1 million images). Users can customize training configurations, including network parameters and training modes, such as progressive growing. While it does not provide pretrained checkpoints, it allows for starting training from previously trained models and offers functionalities for generating samples and calculating quality metrics.

Open Tw Llm Leaderboard is an open-source platform hosted on Hugging Face designed for benchmarking large language models (LLMs). It provides a centralized location for users to browse and filter a leaderboard of various LLM benchmarks. The tool also allows users to submit their own models for evaluation, enabling comparison against existing models and contributing to the broader understanding of LLM performance. This platform is particularly useful for researchers and developers in natural language processing who need to assess and compare different LLM systems.

stat212b is a comprehensive open-source repository on GitHub, offering course materials for a Deep Learning Topics Course from UC Berkeley, taught by Joan Bruna. The curriculum is divided into three main parts: Convolutional Neural Networks, Deep Unsupervised Learning, and Miscellaneous Topics. It covers advanced concepts such as invariance, stability, variability models, scattering extensions, and various types of autoencoders and generative adversarial networks. The repository includes lecture PDFs, reading lists, and guest lectures from prominent researchers like Wojciech Zaremba and Soumith Chintala. This resource is ideal for students and researchers looking to delve into the theoretical and practical aspects of deep learning.

STAT 453: Intro to Deep Learning @ UW-Madison (Spring 2020) is an open-source GitHub repository offering comprehensive course materials for an introductory deep learning class. The repository includes lecture notes, assignments, and code examples covering fundamental concepts such as single-layer neural networks, linear algebra for deep learning, gradient descent, and PyTorch. It also delves into advanced topics like multilayer perceptrons, regularization, convolutional neural networks (CNNs), recurrent neural networks (RNNs), autoencoders, and generative adversarial networks (GANs). This resource is ideal for students and educators looking for structured content to learn or teach deep learning and generative models.

d2l-en is an interactive deep learning book designed to make deep learning approachable through hands-on learning. The entire book is drafted in Jupyter notebooks, seamlessly integrating exposition, figures, math, and interactive examples with self-contained code. It offers sufficient technical depth to serve as a starting point for aspiring applied machine learning scientists and includes runnable code to demonstrate practical problem-solving. The resource is open-source, allowing for rapid updates by both the authors and the community, and is complemented by a forum for technical discussions and questions. Adopted by over 500 universities in 70 countries, including Stanford, MIT, Harvard, and Cambridge, d2l-en is a highly regarded educational tool.

Spektral is an open-source Python library designed for graph deep learning, leveraging the Keras API and TensorFlow 2. It offers a straightforward yet adaptable framework for developing Graph Neural Networks (GNNs). The library supports a wide array of popular convolutional layers, such as GCN, Chebyshev, GraphSAGE, ARMA, ECC, GAT, APPNP, GIN, and Diffusional Convolutions, alongside various pooling layers like MinCut, DiffPool, Top-K, SAG, Global, Global gated attention, and SortPool. Spektral also provides extensive utilities for representing, manipulating, and transforming graphs, making it suitable for tasks like classifying social network users, predicting molecular properties, generating graphs with GANs, and clustering nodes. The 1.0 release introduced standardized Graph and Dataset containers, a new Loader class for batching, a transforms module, and GeneralConv/GeneralGNN classes for simplified model building.

deep-image-prior is an open-source project that offers a novel approach to image restoration using neural networks, notably without requiring a traditional learning phase. It leverages the inherent structure of convolutional neural networks as a prior for image reconstruction. The repository provides Jupyter Notebooks that allow users to reproduce figures and experiments from the associated 'Deep Image Prior' CVPR 2018 paper. This includes notebooks for tasks like denoising, inpainting, super-resolution, and activation maximization. Users should be aware that optimization may not converge on some GPUs, and it's recommended to verify results against the paper's findings, potentially by adjusting precision settings or disabling cudnn.

SymbolicAI is a neuro-symbolic framework designed to integrate classical Python programming with the programmable nature of Large Language Models (LLMs). It emphasizes a modular and extensible design, allowing users to easily create custom engines, host local models, and interface with external tools like web search or image generation. The framework introduces 'Symbol' objects, which can operate in either syntactic (normal Python value) or semantic (neuro-symbolic engine-wired) modes, enabling complex chains of operations. A key differentiator is its implementation of Design by Contract principles for LLMs, helping to build correctness directly into the design through decorators, data models, and validation constraints to mitigate hallucination.

Sudoku is an open-source project hosted on GitHub that explores the application of convolutional neural networks (CNNs) to solve Sudoku puzzles. The project showcases a computational method for tackling this popular number puzzle, which involves filling a 9x9 grid with digits such that each row, column, and 3x3 subgrid contains all digits from 1 to 9. It provides a dataset of 1 million generated Sudoku games for training and includes Python scripts for generating puzzles, training the model, and testing its performance. The model, consisting of 10 blocks of convolution layers, achieves an accuracy of 0.86 in solving Sudoku puzzles, demonstrating the potential of simple CNNs without rule-based postprocessing. This project is valuable for researchers and students interested in AI, machine learning, and problem-solving.

TAADpapers is a meticulously curated list of essential academic papers focusing on textual adversarial attacks and defenses in natural language processing (NLP). Maintained by researchers at UChicago and THUNLP, this resource is invaluable for academics, researchers, and professionals working in NLP, machine learning, and cybersecurity. The collection is organized into key sections including toolkits, survey papers, various levels of attack papers (sentence, word, char, multi-level), defense papers, certified robustness, and benchmarks. Each entry typically includes links to the paper's PDF, and often to associated codebases or websites, making it a practical and accessible reference for staying updated on the latest advancements and challenges in robust NLP.

Pocket is a small AI device designed to capture everything you say and hear, transforming it into organized notes, actionable items, and searchable content. It integrates custom hardware with advanced AI models like GPT-5, Claude, and Gemini to provide a superior note-taking experience for individuals who need to move and think fast. The device offers features such as AI summaries, action items, and mind maps in over 120 languages, supported by studio microphones for clear audio and a contact mic for phone calls. With MagSafe compatibility, a 4-day battery life, and 64GB of storage, Pocket ensures your thoughts are captured instantly and securely, with end-to-end encryption and storage on your device or encrypted U.S. servers.

TextMatch is a comprehensive open-source library designed for various natural language processing tasks, including semantic matching, text classification, text embedding, text clustering, and text retrieval. It provides an easy-to-use framework for training models and exporting representation vectors. The library supports a wide array of models and techniques, ranging from traditional methods like Bow, TFIDF, and Ngram-TFIDF to advanced deep learning models such as BERT, ALBERT, and SimCSE. Additionally, it incorporates algorithms for clustering (Kmeans, DBSCAN), dimensionality reduction (PCA), and efficient similarity search (FAISS). TextMatch is ideal for developers and researchers looking to implement and experiment with different text processing and matching algorithms.

PrecedentAI is an advanced AI-powered legal research tool designed to streamline the legal research process for professionals. It allows users to instantly navigate through a vast database comprising millions of legal cases, briefs, and articles. The platform is engineered to provide precise answers and relevant citations, consolidating all necessary information into a single, efficient search. By leveraging artificial intelligence, PrecedentAI aims to significantly reduce the time and effort typically associated with complex legal inquiries, helping users quickly find the information they need to support their legal arguments and decisions.

Discuria is an AI-powered platform designed for researchers and academics to discover, engage with, and discuss scientific papers. It provides access to over 200 million papers from major databases like arXiv, Semantic Scholar, OpenAlex, CrossRef, and PubMed. Users can search for papers directly or ask questions, with the AI understanding their needs. The platform allows for inline annotations, AI-powered chat for summaries and explanations, and threaded discussions with other researchers. Additionally, users can upload any PDF to annotate and share, and utilize a read-aloud feature with synchronized word highlighting, making complex research more accessible and interactive.

Text-Summarization-Papers offers an exhaustive, open-source list of academic papers focused on text summarization. Curated from eight top conferences including ACL, EMNLP, and NeurIPS, the collection spans from 2013 to 2020. Users can leverage a paper retrieval system to easily find highly-cited papers, track the latest research, and identify milestone works for beginners. The resource also categorizes papers by research concepts, highlighting hot topics and trends since 2019, such as scientific paper-based summarization, new datasets, pretrained models, graph neural networks, and factuality evaluation. It encourages community contributions for updating papers, concepts, and datasets.

GeniusTutor AI is an advanced AI tutor and homework helper designed to support students across a wide range of academic subjects, from STEM to humanities. Powered by sophisticated GPT language models, it not only provides answers but also offers tailored, in-depth guides, breaking down solutions into manageable steps and explaining relevant concepts and theorems. The tool focuses on contextual analysis, ensuring explanations are relevant to the specific problem. It highlights key formulas and rules, making it suitable for high school students, college students, and lifelong learners seeking to deepen their understanding and improve academic performance. GeniusTutor AI is interactive and easy to use, allowing users to input questions via text or image upload.

tf-dann is an open-source implementation of Domain-Adversarial Neural Networks (DANN) in Tensorflow, designed to address domain adaptation challenges. It leverages a gradient reversal layer to enable unsupervised domain adaptation through backpropagation, allowing models to generalize effectively across different domains even without labeled data in the target domain. The repository includes practical examples, such as experiments on a simple Blobs dataset and a recreation of the MNIST experiment from the original DANN papers. It provides instructions for generating the synthetic MNIST-M dataset and details the implementation of the `flip_gradient` operation using `tf.gradient_override_map`. This tool is ideal for researchers and developers working on machine learning models that need to perform well across varied data distributions.

tf-rnn-attention provides a Tensorflow implementation of the attention mechanism specifically designed for text classification tasks. This open-source project is inspired by the research presented in "Hierarchical Attention Networks for Document Classification" by Zichao Yang et al. It serves as a valuable resource for developers and researchers looking to integrate attention mechanisms into their natural language processing models. The repository includes Python code for attention, training, and utility functions, along with a visualization example. Users can leverage this tool to build and experiment with text classification models that benefit from the interpretability and performance enhancements offered by attention mechanisms.