philschmid.de - RSS feed

Benchmark evaluating varying sizes of Llama 2 on a range of Amazon EC2 instance types with different load levels on latency (ms per token), and throughput (tokens per second).

In this example we will show how to fine-tune Falcon 180B using DeepSpeed, Hugging Face Transformers, LoRA with Flash Attention on a multi-GPU machine.

Learn how to fine-tune Falcon 180B with QLoRA and Flash Attention on Amazon SageMaker.

Learn how to deploy Falcon 180B to Amazon SageMaker and how to create a chatbot with streaming inference.

Learn how to quantize Llama 2 7B with GPTQ to use 4x less memory.

Learn how to use Infrastructure as Code with (AWS CDK)] to deploy and manage Llama 2

Learn how to deploy Llama 2 models (7B - 70B) to Amazon SageMaker using the Hugging Face LLM Inference DLC.

EasyLLM is an open-source project that provides helpful tools and methods for working with large language models (LLMs).

This blog post is an extended guide on instruction-tuning Llama 2 from Meta AI

All Resources for LLaMA 2, How to test, train, and deploy it.

Learn how to train LLaMa 2 using QLoRA Hugging Face Transformers on Amazon SageMaker

Learn how to train LLMs using QLoRA on Amazon SageMaker

Learn how to deploy LLMs using Hugging Face Inference Endpoints

Learn how to optimize and deploy BERT on AWS Inferentia2

Learn how to deploy LLMs into VPCs from S3 with Amazon SageMaker using the new Hugging Face LLM Inference DLC.

Learn how to deploy Falcon 40B to Amazon SageMaker using the new Hugging Face LLM Inference DLC.

Learn how to fine-tune Hugging Face Transformers using AWS Trainium.

Learn how to deploy the open-source LLMs, like BLOOM to Amazon SageMaker for inference using the new Hugging Face LLM Inference Container.

Learn how to fine-tune Donut-base a Generative AI model for document-understand/document-parsing using Hugging Face Transformers and Amazon SageMaker.

Learn how to fine-tune LLMs on multi-node setups using Amazon SageMaker and Hugging Face Transformers with PyTorch FSDP

Learn how to quickly set up an AWS Trainium using the Hugging Face Neuron Deep Learning AMI and fine-tune BERT

Learn how to fine-tune BLOOMZ 7B with Amazon SageMaker on a Single GPU using LoRA Hugging Face Transformers.

IGEL (Instruction-based German Language Model) is an LLM designed for German language understanding tasks, including sentiment analysis, language translation, and question answering.

Learn how to fine-tune Google's FLAN-T5 XXL on a Single GPU using LoRA And Hugging Face Transformers.

Learn how to deploy Google's FLAN-UL 20B on Amazon SageMaker for inference.

Learn how to get started with Pytorch 2.0 and Hugging Face Transformers and reduce your training time up to 2x.

Learn how to deploy ControlNet Stable Diffusion Pipeline on Hugging Face Inference Endpoints to generate controlled images.

Learn how to fine-tune Google's FLAN-T5 XXL on Amazon SageMaker using DeepSpeed and Hugging Face Transformers.

Learn how to fine-tune Google's FLAN-T5 XXL using DeepSpeed and Hugging Face Transformers.

Learn how to deploy Google's FLAN-T5 XXL on Amazon SageMaker for inference.

Learn how to leverage Hugging Face Transformers to easily fine-tune your models.

Learn how to get started with Hugging Face Transformers and TPUs using PyTorch, fine-tune a BERT model for Text Classification using the newest Google Cloud TPUs.

Learn how to fine-tune Google's FLAN-T5 for chat and dialogue summarization using Hugging Face Transformers.

Learn how to deploy OpenAI Whisper for speech recognition and transcription using Hugging Face Inference Endpoints.

Learn how to deploy Stable Diffusion 2.0 Inpainting on Hugging Face Inference Endpoints to manipulate images.

Learn how to deploy Stable Diffusion 2.0 on Hugging Face Inference Endpoints to generate images based from text.

Learn how to fine-tune LiLt (Language independent Layout Transformer) for document-understand/document-parsing using Hugging Face Transformers.

Learn how to deploy a multiple models on to a GPU with Hugging Face multi-model inference endpoints.

Learn how to deploy a Hugging Face Gradio Application using Hugging Face Transformers to AWS Lambda for serverless workloads.

Learn how to optimize Stable Diffusion for GPU inference with a 1-line of code using Hugging Face Diffusers and DeepSpeed.

Learn how to deploy Stable Diffusion to Amazon SageMaker to generate images.

Learn how to deploy T5 11B on a single GPU using Hugging Face Inference Endpoints.

Learn how to use SetFit to create a text-classification model with only a `8` labeled samples per class, or `32` samples in total.

Learn how to fine-tune LayoutLM for document-understand using Keras and Hugging Face Transformers.

Learn how to deploy LayoutLM for document-understand using Hugging Face Inference Endpoints.

Learn how to fine-tune LayoutLM for document-understand using Hugging Face Transformers.

Welcome to this tutorial on how to create a custom inference handler for Hugging Face Inference Endpoints.

Learn how to optimize GPT-J for GPU inference with a 1-line of code using Hugging Face Transformers and DeepSpeed.

Learn how to fine-tune Donut-base for document-understand/document-parsing using Hugging Face Transformers.

Learn how to Sentence Transformers model with TensorFlow and Keras for creating document embeddings