Research & Education

llm_note is an extensive collection of notes and resources designed for individuals looking to deepen their understanding of large language models (LLMs). It covers fundamental aspects such as LLM inference, the intricate structure of transformer models, and detailed code analysis of various LLM frameworks. Additionally, the resource delves into high-performance computing (HPC) topics, offering insights into Triton and CUDA programming for optimizing LLM operations. The project also features a self-made large model inference framework, built with Triton and PyTorch, emphasizing lightweight design and ease of use. This framework aims to simplify GPU kernel development by leveraging PyTorch-like syntax for Triton operators, bypassing the complexities of direct CUDA programming. It includes support for advanced features like FlashAttention and PageAttention, and demonstrates significant speed improvements over standard libraries for certain LLM models.

LLMForEverybody is a comprehensive resource designed to make large language model (LLM) knowledge accessible to everyone. It features a curated database of LLM interview questions, covering topics from foundational concepts to advanced applications, ideal for job seekers preparing for spring/autumn recruitment drives. The platform also offers a systematic approach to studying LLM research papers, starting from the 2017 Transformer paper and progressing through key technological advancements. Complementing these resources are continuously updated video tutorials available on Bilibili and YouTube, ensuring a multi-modal learning experience. The goal is to equip users with the knowledge to confidently discuss LLMs with interviewers and advance their careers.

Chatlingo is an AI-powered language learning application designed to make language acquisition fun and effective through real conversation practice. Featuring Ringo, an AI character with personality, the app engages users in natural dialogues, remembers their progress, and adapts to their skill level. Unlike traditional language learning methods, Chatlingo focuses on immersive conversational experiences rather than drills or vocabulary lists. It supports Japanese, Korean, English, Spanish, French, and Mandarin Chinese, with more languages planned. Available on both iOS and Android, Chatlingo offers a free plan with daily AI conversation practice, making it accessible for beginners and advanced learners alike.

Semactic is an SEO activation platform designed to help marketing teams transform SEO recommendations into concrete, measurable actions aligned with business priorities. It offers both SEO and GEO (Generative Engine Optimization) features, including tools to drive visibility in AI Search and get mentioned in platforms like ChatGPT. The platform provides a custom roadmap, a content marketing idea generator, and a Trello-like interface for managing SEO and GEO action plans. Semactic also focuses on growing in-house SEO and GEO skills through 1:1 sessions with experts and free learning resources, making complex SEO concepts more accessible and actionable for digital teams.

SPSSAU is an intelligent online statistical analysis platform designed to make data analysis accessible and efficient. It provides a comprehensive suite of over 500 analytical methods, such as T-tests, ANOVA, regression, correlation, clustering, and factor analysis. The platform features a "drag-and-drop" interface, allowing users to easily select analysis items and generate results with a single click. SPSSAU integrates AI to intelligently analyze data, suggest appropriate analytical options, and automate the generation of standardized analysis reports, including textual interpretations and visualizations. It also offers data processing functions like data labeling, encoding, and variable generation, alongside automatic chart generation. The platform supports both English and Chinese, offers robust security with阿里云 servers and data backup, and provides academic and enterprise-level research report services.

Learn Place Verified Experience provides an AI-powered virtual internship program designed for students, recent graduates, and career changers. The platform offers real-world projects with AI assistance, allowing users to build a professional portfolio that employers can verify. Key features include verified skills tied to completed milestones, a rigorous review process with detailed AI feedback, and video final reviews where interns explain their work. The program aims to bridge the gap between academic qualifications and the practical experience required for entry-level jobs, offering an interview guarantee and support for career advancement. It also includes anti-cheating verification and tamper-proof records to ensure the authenticity of the experience.

ml-basics is an open-source repository hosted on GitHub, offering a collection of exercise notebooks specifically designed for Machine Learning modules available on Microsoft Learn. This resource provides practical, hands-on experience for individuals looking to understand and apply fundamental machine learning concepts. The repository includes notebooks covering various topics such as data exploration, regression, classification, clustering, and deep neural networks using both PyTorch and TensorFlow. It serves as a valuable supplementary tool for students and learners engaging with Microsoft's official machine learning curriculum, allowing them to practice coding and reinforce their theoretical knowledge with real-world examples.

The Applied-AI Center at HSLU (Lucerne University of Applied Sciences and Arts) is a leading institution for education and research in applied artificial intelligence. It provides a comprehensive range of offerings, including practice-oriented Bachelor's and Master's degree programs, innovative research initiatives, and more than 600 continuing education courses designed for professional development. Students and professionals benefit from a strong foundation of knowledge, close collaboration with companies, and future-oriented career opportunities. The center focuses on bridging the gap between academic theory and real-world application, ensuring graduates are well-equipped for the evolving AI landscape.

Macaw-LLM is an exploratory open-source project that pioneers multi-modal language modeling by seamlessly combining image, video, audio, and text data. Built upon the foundations of CLIP, Whisper, and LLaMA, it offers a unique approach to integrating diverse data types. Key features include simple and fast alignment to LLM embeddings, one-stage instruction fine-tuning, and a newly created multi-modal instruction dataset covering image and video modalities. The architecture leverages CLIP for image/video encoding, Whisper for audio encoding, and LLaMA (or Vicuna/Bloom) as the core language model. This tool is designed for researchers and developers to explore and advance the field of multi-modal AI.

MyLessonPal is an AI-powered lesson planning tool designed specifically for teachers, aiming to streamline the creation of educational content. It delivers standards-aligned teaching resources directly to the user's inbox every morning, significantly reducing the time spent on lesson preparation. The platform helps educators save over 12 hours a week by acting as an AI teaching assistant. While the live content doesn't detail specific features beyond 'standards-aligned teaching resources,' the core value proposition is clear: efficient and automated lesson plan generation to support teachers in their daily tasks. This tool is ideal for educators looking to enhance productivity and ensure their teaching materials meet required standards with minimal effort.

Machine_Learning_Resources is an open-source GitHub repository designed to help individuals prepare for machine learning interviews. It provides a curated collection of useful links covering essential topics such as feature engineering, algorithm basics, evaluation metrics, and optimization algorithms. The resource also includes sections on NLP, recommendation systems, and recommended books and columns for further study. It explicitly notes that it does not include basic algorithms already well-explained in standard textbooks, encouraging users to refer to those foundational resources directly. This repository serves as a comprehensive guide for job seekers and students looking to solidify their understanding of machine learning concepts for interview success.

MachineLearningNotes is a GitHub repository containing a comprehensive collection of personal notes on various machine learning topics. These notes are primarily derived from video lectures and are formatted as Markdown files. The repository covers a wide range of subjects, including linear regression, classification, dimension reduction, SVM, exponential family, probabilistic graphical models, EM, GMM, variational inference, MCMC, HMM, LDS, particle filters, CRF, Gaussian networks, Bayesian linear regression, Gaussian processes, RBM, spectral methods, neural networks, partition functions, and approximate inference. Users are advised to download the content and view it locally using Typora for proper rendering of mathematical formulas and graphs, as GitHub's native rendering may not fully support these elements. The project also provides a link to a Bilibili video series as a reference.

The NSF AI Institute for Artificial Intelligence and Fundamental Interactions (IAIFI) is a leading institute dedicated to pioneering interdisciplinary research at the intersection of AI and physics. It aims to advance fundamental physics knowledge, from the smallest building blocks of nature to the largest structures in the Universe, while simultaneously galvanizing AI research innovation. IAIFI focuses on developing AI approaches that incorporate first principles from physics and tackles challenging problems such as precision calculations and gravitational wave detection. Beyond research, IAIFI is committed to empowering the next generation of AI+Physics talent through various educational programs, including fellowships, summer schools, and workshops, and building a dynamic AI+Physics community through events and collaborations.

Otto SEO, part of the Search Atlas platform, is an AI-powered SEO automation tool designed to revolutionize how agencies and brands manage their SEO. It aims to improve website authority, content quality, technical performance, and user engagement, leading to maximum organic traffic. Key features include the Atlas Brain conversational SEO agent, which runs thousands of tasks across over 60 tools, and OTTO SEO for tracking rankings, site health, and performance. The platform also offers LLM Visibility to see where content appears in AI answers and GBP Galactic for managing Google Business Profiles. It is positioned as a comprehensive solution to replace multiple SEO tools, offering white-labeled dashboards and automated reporting for agencies.

PreciseRoIPooling is an open-source implementation of the Precise RoI Pooling (PrRoI Pooling) method, as proposed in the ECCV 2018 paper "Acquisition of Localization Confidence for Accurate Object Detection." This tool is designed to improve object detection accuracy by providing an integration-based average pooling method for RoI Pooling, which avoids quantization and offers a continuous gradient on bounding box coordinates. Unlike traditional RoI Pooling or RoI Align, PrRoI Pooling allows for the optimization of RoI coordinates through continuous gradients. The repository provides implementations for PyTorch (versions 1.0+ and 0.4) and TensorFlow (2.2), primarily supporting CUDA. It is a valuable resource for researchers and developers working on advanced object detection models.

T2F is an open-source deep learning project designed for generating realistic human faces from textual descriptions. It leverages a combination of StackGAN and ProGAN architectures to achieve high-quality image synthesis. The project processes textual descriptions through an LSTM network to create a summary vector, which then informs the GAN's generation process. While the original project is not actively maintained, a T2F 2.0 version is planned to utilize MSG-GAN for improved image generation. The tool is implemented using PyTorch and requires specific dependencies for setup and training, making it suitable for researchers and developers interested in generative AI.

T81-558 is a comprehensive GitHub repository containing teaching materials for the T81-558: Keras - Applications of Deep Neural Networks course offered at Washington University in St. Louis. This resource focuses on the Keras/TensorFlow version of the curriculum, covering a wide array of deep learning topics. Students and enthusiasts can explore modules on Python preliminaries, Pandas for machine learning, TensorFlow and Keras fundamentals, training for tabular data, regularization, CNNs for vision, Generative Adversarial Networks (GANs), Kaggle competitions, transfer learning, time series analysis, reinforcement learning, and deploying models with Flask. The repository includes Jupyter notebooks for practical application and a complete textbook available on GitHub, making it an invaluable resource for learning and applying deep neural network concepts.

Teaching-material is a comprehensive open-source repository designed to provide preparatory materials for machine learning and deep learning courses. Developed for use at prestigious institutions like Stanford and Cornell, it focuses on foundational skills in Python and Numpy. The repository includes tutorials essential for students embarking on advanced machine learning studies, covering topics relevant to probabilistic graphical models, deep learning, applied machine learning, and deep generative models. It offers an iPython notebook for interactive learning, which can be followed directly on GitHub or executed locally, making it a flexible resource for both self-study and structured academic environments.

Singa is an open-source distributed deep learning platform developed by Apache. It provides a flexible architecture for training deep learning models across various devices and distributed environments. The platform supports a wide range of deep learning models and offers tools for efficient computation and data management. Singa is particularly well-suited for researchers and developers who require a robust and scalable solution for their large-scale AI projects, enabling them to build, train, and deploy complex neural networks. Its open-source nature fosters community contributions and allows for extensive customization to meet specific project requirements.

rnn-tutorial-rnnlm is an open-source project available on GitHub, offering a comprehensive tutorial for implementing Recurrent Neural Networks (RNNs). Specifically, it focuses on Part 2 of a tutorial series, guiding users through the process of building an RNN in Python and Theano. The repository includes all necessary code, a Jupyter Notebook for interactive learning, and detailed setup instructions. It covers both local development environments and advanced configurations for CUDA-enabled GPU instances on platforms like EC2, making it suitable for developers looking to understand and implement RNNs for language modeling and other sequential data tasks. The project is licensed under Apache-2.0.

The-HustleGPT-Challenge is an open-source repository dedicated to documenting and showcasing ventures born from the HustleGPT challenge, where individuals partner with an AI co-founder to build a business. It provides a curated list of these AI-powered startup endeavors, including their descriptions, co-founder status (e.g., building, made $1+, discontinued), and categories like Art, Business Resources, ChatGPT and AI, Eco-Friendly, and Education. The repository also outlines the challenge's prompt and offers a guide for participation, making it a central hub for those interested in or actively involved in building businesses with AI assistance. It serves as a resource for inspiration, tracking progress, and connecting with a community of AI-driven entrepreneurs.

Cram Wizard is an AI-powered learning platform designed to enhance learning efficiency through study-backed strategies. The platform focuses on providing personalized learning paths, aiming to optimize study habits for users. It helps students learn more effectively and prepare for tests by tailoring content and methods to individual needs. While specific features are not detailed on the current website, the core offering revolves around leveraging AI to create a more effective and personalized educational experience.

prml is an open-source GitHub repository dedicated to Christopher Bishop's seminal work, "Pattern Recognition and Machine Learning." It provides a comprehensive collection of Jupyter notebooks and Python code that implement many of the algorithms and replicate numerous graphs presented in the book. This resource is invaluable for students, professors, and researchers looking to understand and apply machine learning concepts through practical examples. The repository covers a wide range of topics, from basic probability distributions and linear models to more advanced subjects like neural networks, Gaussian processes, and hidden Markov models, making it a robust companion for academic study and practical implementation in the field of pattern recognition and machine learning.

PolyBuzz revolutionizes the way users interact with AI chatbots by offering characters that think and reply like real people, complete with authentic voices. Users can choose from a massive selection of characters, including celebrities, movie figures, and historical personalities. A standout feature is the character creation tool, allowing users to bring any character to life, whether real or imaginary, and keep them private or share them with the community. The app provides easy and free conversations, ensuring endless story possibilities without repetition. It's designed for anyone who enjoys chatting, learning, and exploring, offering constant entertainment with a continually growing selection of personalities and no language barriers.