中文羊驼大模型三期项目 (Chinese Llama-3 LLMs) developed from Meta Llama 3

中文Mixtral混合专家大模型（Chinese Mixtral MoE LLMs）

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

llama.cpp with unicode (windows) support

中文LLaMA&Alpaca大语言模型+本地CPU/GPU训练部署 (Chinese LLaMA & Alpaca LLMs)

FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.

GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

A PyTorch-based model pruning toolkit for pre-trained language models

A PyTorch-based knowledge distillation toolkit for natural language processing

LERT: A Linguistically-motivated Pre-trained Language Model（语言学信息增强的预训练模型LERT）

CINO: Pre-trained Language Models for Chinese Minority (少数民族语言预训练模型)

PERT: Pre-training BERT with Permuted Language Model

Pre-Trained Chinese XLNet（中文XLNet预训练模型）

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Revisiting Pre-trained Models for Chinese Natural Language Processing (MacBERT)

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）