Post
I'm working on talking head generation that takes audio and video as input, can someone suggest me a good existing architecture that can generate videos with less latency or can we make it in real time?
Join the conversation
Join the community of Machine Learners and AI enthusiasts.
Sign UpAll HF Hub posts
hakunamatata1997ย
posted an update
8 minutes ago
Post
๐ชBuild an information retrieval Agent that can beat Gemini and OpenAI using open-source Large Action Model framework!
In this video, we ask to different proprietary Conversational AI the question:
โWhat is the most trendy recent paper on Llava models on Hugging Face papers? Provide the date and a summary of the paperโ, and the results are interesting!
โGemini: found a paper from Jan 29, 2024
โOpenAI: found a paper from October 2023
โYou.com: found a paper from Jan 29 2024
โ LaVague: found the latest paper (ConvLlaVA which is dope by the way https://arxiv.org/abs/2405.15738)!
The best? Our solution fits a few ines of code with our open-source framework! I will share how we built that agent during our webinar on AI Web Agents, this Thursday 30th May at 9 am PST (https://lu.ma/m8fzmb3q) so donโt miss it ๐
You can also start playing with our framework: https://github.com/lavague-ai/LaVague
In this video, we ask to different proprietary Conversational AI the question:
โWhat is the most trendy recent paper on Llava models on Hugging Face papers? Provide the date and a summary of the paperโ, and the results are interesting!
โGemini: found a paper from Jan 29, 2024
โOpenAI: found a paper from October 2023
โYou.com: found a paper from Jan 29 2024
โ LaVague: found the latest paper (ConvLlaVA which is dope by the way https://arxiv.org/abs/2405.15738)!
The best? Our solution fits a few ines of code with our open-source framework! I will share how we built that agent during our webinar on AI Web Agents, this Thursday 30th May at 9 am PST (https://lu.ma/m8fzmb3q) so donโt miss it ๐
You can also start playing with our framework: https://github.com/lavague-ai/LaVague
Post
Cohere for AI, Argilla, and Hugging Face are collaborating on an Open Science Project to enhance multilingual model evaluations. The project focuses on the widely-used MMLU dataset, which spans 57 subjects like mathematics, computer science, and law. However, existing translations often miss linguistic and cultural nuances, thus embedding biases. ๐ค
To address this, they have annotated a subset of the MMLU test set and are inviting global perspectives to review prompts, highlighting cultural specifics and required knowledge. They have mentioned that insights will help shape future multilingual model evaluations, ensuring they are more inclusive and accurate. ๐บ๏ธ ๐ ๐
โถ๏ธ To get started go to: CohereForAI/MMLU-evaluation
๐ They also have an Aya Discord server for collaboration with other participants: https://discord.gg/9gVhdfnQMN
To address this, they have annotated a subset of the MMLU test set and are inviting global perspectives to review prompts, highlighting cultural specifics and required knowledge. They have mentioned that insights will help shape future multilingual model evaluations, ensuring they are more inclusive and accurate. ๐บ๏ธ ๐ ๐
โถ๏ธ To get started go to: CohereForAI/MMLU-evaluation
๐ They also have an Aya Discord server for collaboration with other participants: https://discord.gg/9gVhdfnQMN
Post
I'm officially considered #gpu_poor ๐
But I'm #data_rich ๐
But I'm #data_rich ๐
Post
๐ฃ๐ฟ๐ผ๐๐ผ๐๐๐ฝ๐ถ๐ป๐ด holds an important place in machine learning. But it has traditionally been quite difficult to go from prototype code to production-ready APIs
We're working on making that a lot easier with ๐๐ฟ๐ฎ๐ฑ๐ถ๐ผ and will unveil something new on June 6th: https://www.youtube.com/watch?v=44vi31hehw4&ab_channel=HuggingFace
We're working on making that a lot easier with ๐๐ฟ๐ฎ๐ฑ๐ถ๐ผ and will unveil something new on June 6th: https://www.youtube.com/watch?v=44vi31hehw4&ab_channel=HuggingFace
as-cle-bertย
posted an update
about 10 hours ago
Post
everything-ai v2.0.1: more AI power on your Desktop
What is everything-ai?
๐ค everything-ai is natively a multi-tasking agent, 100% local, that is able to perform several AI-related tasks
What's new?
๐ I am more than thrilled to introduce some new functionalities that were added since last release:
- ๐๏ธ๐ Handle audio files or microphone recordings, classifying or transcribing them with almost every audio-classification and automatic-speech-recognition model on Hugging Face Hub.
- ๐ฝ๏ธ Generate video from text prompts with almost every text-to-video model on HuggingFace Hub (original architecture by [Vasiliy Katsyka](https://github.com/Vasiliy-katsyka))
- ๐งฌ Predict the 3D structure of proteins from their amino-acidic sequence, with EsmFold by AI at Meta ([demo]( as-cle-bert/proteinviz)
- ๐๏ธ Finetune HF models on several downstream tasks with AutoTrain local integration (AutoTrain is developed by [Abhishek Thakur](https://github.com/abhishekkrthakur))
- ๐ฃ๏ธ Unleash powerful LLMs and exploit larger database collections for RAG with the integration of Hugging Face Spaces API and Supabase PostgreSQL databases ([demo]( as-cle-bert/supabase-ai-chat)
How can you use all of these features?
You just need a
Where can I find everything I need?
Get the source code (and leave a little โญ while you're there):
https://github.com/AstraBert/everything-ai
Get a quick-start with the documentation:
https://astrabert.github.io/everything-ai/
Credits and inspiration
Shout-outs to Hugging Face, Gradio, Docker, AI at Meta, Abhishek Thakur, Qdrant, LangChain and Supabase for making all of this possible!
Inspired by: Jan, Cheshire Cat AI, LM Studio, Ollama and other awesome local AI solutions!
What is everything-ai?
๐ค everything-ai is natively a multi-tasking agent, 100% local, that is able to perform several AI-related tasks
What's new?
๐ I am more than thrilled to introduce some new functionalities that were added since last release:
- ๐๏ธ๐ Handle audio files or microphone recordings, classifying or transcribing them with almost every audio-classification and automatic-speech-recognition model on Hugging Face Hub.
- ๐ฝ๏ธ Generate video from text prompts with almost every text-to-video model on HuggingFace Hub (original architecture by [Vasiliy Katsyka](https://github.com/Vasiliy-katsyka))
- ๐งฌ Predict the 3D structure of proteins from their amino-acidic sequence, with EsmFold by AI at Meta ([demo]( as-cle-bert/proteinviz)
- ๐๏ธ Finetune HF models on several downstream tasks with AutoTrain local integration (AutoTrain is developed by [Abhishek Thakur](https://github.com/abhishekkrthakur))
- ๐ฃ๏ธ Unleash powerful LLMs and exploit larger database collections for RAG with the integration of Hugging Face Spaces API and Supabase PostgreSQL databases ([demo]( as-cle-bert/supabase-ai-chat)
How can you use all of these features?
You just need a
docker compose up!๐Where can I find everything I need?
Get the source code (and leave a little โญ while you're there):
https://github.com/AstraBert/everything-ai
Get a quick-start with the documentation:
https://astrabert.github.io/everything-ai/
Credits and inspiration
Shout-outs to Hugging Face, Gradio, Docker, AI at Meta, Abhishek Thakur, Qdrant, LangChain and Supabase for making all of this possible!
Inspired by: Jan, Cheshire Cat AI, LM Studio, Ollama and other awesome local AI solutions!
Post
Just released ViLaH - a compact 3B parameter vision language model! which generates responses in Hindi only hindi for now ๐
BhashaAI/ViLaH
BhashaAI/ViLaH
- 2 replies
Post
Weekly highlights for the HF ecosystem!
๐ Phi 3
๐ฆ Falcon VLM
๐ค sentence-transformers v3.0 is here! Train and finetune embedding models with multi-GPU training, bf16 support, loss logging, callbacks and more!
๐ฅณ Gradio launch event 6/6! We're launching 1.0 versions of two new libraries, Python + JS client libraries to programmatically query Gradio apps, and several new features making it easier to use Gradio apps in production!
โจ Tools now available in HuggingChat! Use any AI apps built by the community! ๐ฅ
๐ง ML for 3D Course Unit 3 is here! Covering Gaussian splatting, how it fits in the generative 3D pipeline, and hands-on code to build your own demo!
See the full list here!
https://discord.com/channels/879548962464493619/897387888663232554/1245036889539612764 !
๐ Phi 3
๐ฆ Falcon VLM
๐ค sentence-transformers v3.0 is here! Train and finetune embedding models with multi-GPU training, bf16 support, loss logging, callbacks and more!
๐ฅณ Gradio launch event 6/6! We're launching 1.0 versions of two new libraries, Python + JS client libraries to programmatically query Gradio apps, and several new features making it easier to use Gradio apps in production!
โจ Tools now available in HuggingChat! Use any AI apps built by the community! ๐ฅ
๐ง ML for 3D Course Unit 3 is here! Covering Gaussian splatting, how it fits in the generative 3D pipeline, and hands-on code to build your own demo!
See the full list here!
https://discord.com/channels/879548962464493619/897387888663232554/1245036889539612764 !
-
- 2 replies
Post
๐งจ Diffusers 0.28.0 is out ๐ฅ
It features the first non-generative pipeline of the library -- Marigold ๐ฅ
Marigold shines at performing Depth Estimation and Surface Normal Estimation. It was contributed by @toshas , one of the authors of Marigold.
This release also features a massive refactor (led by @DN6 ) of the
Check out the release notes here:
https://github.com/huggingface/diffusers/releases/tag/v0.28.0
It features the first non-generative pipeline of the library -- Marigold ๐ฅ
Marigold shines at performing Depth Estimation and Surface Normal Estimation. It was contributed by @toshas , one of the authors of Marigold.
This release also features a massive refactor (led by @DN6 ) of the
from_single_file() method, highlighting our efforts for making our library more amenable to community features ๐คCheck out the release notes here:
https://github.com/huggingface/diffusers/releases/tag/v0.28.0
Post
cooking up something....anyone interested in a daily activity tracker for HF?
-
- 3 replies
