#

large-scale-machine-learning

Here are 25 public repositories matching this topic...

EthicalML / awesome-production-machine-learning

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

machine-learning data-mining awesome deep-learning awesome-list interpretability privacy-preserving production-machine-learning mlops privacy-preserving-machine-learning explainability responsible-ai machine-learning-operations ml-ops ml-operations privacy-preserving-ml large-scale-ml production-ml large-scale-machine-learning

Updated Apr 16, 2026

distributed-ml-patterns

terrytangyuan / distributed-ml-patterns

Distributed Machine Learning Patterns from Manning Publications by Yuan Tang https://bit.ly/2RKv8Zo

python kubernetes devops distributed-systems data-science machine-learning book tensorflow cloud-computing argo cloud-native machine-learning-pipelines distributed-machine-learning kubeflow mlops large-scale-machine-learning argo-workflows manning-publications

Updated Jan 6, 2026
Python

openpsi-project / ReaLHF

Super-Efficient RLHF Training of LLMs with Parameter Reallocation

distributed-systems reinforcement-learning distributed-computing transformers large-scale-machine-learning deepspeed megatron-lm large-language-models llm reinforcement-learning-from-human-feedback llm-training llm-framework

Updated Apr 24, 2025
Python

DeepFace

swghosh / DeepFace

Keras implementation of the renowned publication "DeepFace: Closing the Gap to Human-Level Performance in Face Verification" by Taigman et al. Pre-trained weights on VGGFace2 dataset.

facebook cnn face-recognition deepface large-scale-machine-learning vggface2-dataset cloud-tpu

Updated Jul 11, 2021
Python

natnew / Awesome-Data-Science

Carefully curated list of awesome data science resources.

data-science data machine-learning awesome ai deep-learning interoperability awesome-list explainable-ai responsible-ai machine-learning-operations ml-operations large-scale-machine-learning

Updated Feb 18, 2026
Jupyter Notebook

Perceiver-Music-Transformer

asigalov61 / Perceiver-Music-Transformer

SOTA Google's Perceiver-AR Music Transformer Implementation and Model

google midi music-composition artificial-intelligence music-generation sota large-scale-machine-learning music-transformer music-ai text-to-music music-generation-deep-learning multi-instrumental piano-transformer perceiver-ar

Updated May 9, 2023
Python

astorfi / Large-Scale-AI-Blueprint

A comprehensive guide designed to empower readers with advanced strategies and practical insights for developing, optimizing, and deploying scalable AI models in real-world applications.

deep-learning large-scale production-ml large-scale-machine-learning machinel-learning large-language-models llms large-scale-ai

Updated Apr 12, 2024

nilesh2797 / zestxml

This is the official codebase for KDD 2021 paper Generalized Zero-Shot Extreme Multi-Label Learning

machine-learning extreme-classification large-scale-machine-learning generalized-zero-shot-learning

Updated Jul 25, 2022
C++

ishugaepov / MLBD

Materials for "Machine Learning on Big Data" course

machine-learning big-data spark mapreduce distributed-machine-learning large-scale-machine-learning

Updated Jul 23, 2023
Jupyter Notebook

knagrecha / hydra

Execution framework for multi-task model parallelism. Enables the training of arbitrarily large models with a single GPU, with linear speedups for multi-gpu multi-task execution.

machine-learning deep-learning gpu distributed-computing pytorch machine-learning-library task-parallel systems-engineering large-scale-machine-learning model-parallel

Updated Aug 13, 2023
Python

alexrenz / AdaPM

A fully adaptive, zero-tuning parameter manager that enables efficient distributed machine learning training

parameter-server distributed-training distributed-ml large-scale-machine-learning parameter-management

Updated Feb 23, 2023
C++

Euterpe

asigalov61 / Euterpe

[DEPRECEATED] Multi-Instrumental Music Transformer trained on 12GB/400k MIDIs

music midi music-composition muse music-generation large-scale sota euterpea large-scale-machine-learning music-transformer music-ai music-ai-architectures euterpe multi-instrumental

Updated Oct 5, 2022
Python

GIGA-Piano

asigalov61 / GIGA-Piano

[DEPRECEATED] Piano Transformer model trained on 2.6GB of MIDI piano music

midi music-composition artificial-intelligence piano music-generation music-composer symbolic-music-data large-scale-machine-learning music-transformer music-ai midi-music music-ai-architectures symbolic-music piano-transformer

Updated Oct 10, 2022
Python

swghosh / FaceNet

Keras implementation of the renowned publication "FaceNet: A Unified Embedding for Face Recognition and Clustering" by Schroff et al.

google face-recognition facenet googlenet triplet-loss keras-tensorflow face-verification large-scale-machine-learning

Updated Mar 25, 2023
Python

akashsonowal / interview-prep

Crack SWE (ML) / DS MAANG Interviews

python distributed-systems algorithms tensorflow pytorch data-structures jax mlops large-scale-machine-learning ml-engineering

Updated May 27, 2025
Python

Jacob-Chmura / tgn.cpp

C++ Port of Temporal Graph Networks for Deep Learning on Dynamic Graphs

large-scale-machine-learning temporal-graphs temporal-graph-networks

Updated Mar 23, 2026
C++

anirudhb11 / LEVER

Official Code Base for ICLR 2024 paper Enhancing Tail Performance in Extreme Classifiers by Label Variance Reduction

machine-learning information-retrieval distillation extreme-classification large-scale-machine-learning

Updated Mar 14, 2024
Python

khushnood / DeepLearningJavaFromScratch

This project is for developing a deep neural networks and its variant from scratch. No external libraries are used except for GPU operations.

java deep-learning regression classification gpu-computing deep-neural-network large-scale-machine-learning

Updated May 11, 2021
Java

importrayhan / Exam-Result-with-Deep-Learning

Our full length research is finally acknowledged through double-blind review procedure.

educational-data-mining explainable-ai large-scale-machine-learning

Updated Jun 8, 2022

Shaswat-G / PyRecover

Robust distributed checkpointing and job management system for multi-GPU SLURM workloads

deep-learning hpc fault-tolerance slurm pytorch high-performance-computing gpu-computing multi-gpu cluster-computing job-management distributed-training large-scale-machine-learning checkpointing

Updated Jun 2, 2025
Python

Improve this page

Add a description, image, and links to the large-scale-machine-learning topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the large-scale-machine-learning topic, visit your repo's landing page and select "manage topics."