Developer Tools

Amazon's New AI Service Lets You Customize Models Without Managing Servers

Amazon's New AI Service Lets You Customize Models Without Managing Servers

⚡Now you can fine-tune AI models without the headache of servers—saving time and money.

Deep Dive

Amazon SageMaker AI's serverless model customization is expanding with training session APIs. Instead of abstracting away the algorithm, they abstract away the compute: operations like forward_backward(), optim_step(), and sample() become SageMaker API calls you compose into whatever procedure your technique requires — SFT, preference optimization, RL, or something new.

The calls target a live, stateful session, so the model stays loaded on the GPUs across steps. You write the training loop, and SageMaker AI runs the infrastructure: runtime setup, distributed execution, gradient synchronization, fault recovery, tenant isolation, and the operations of running GPUs at scale.

You drive it from your own Python process, so you can iterate and debug quickly. Alongside the service, a training sessions cookbook offers ready-to-run SFT and RL recipes you can use as blueprints for your own training loops.

Key Points
  • Amazon's new service lets you customize AI models without managing servers or GPUs.
  • You write the training code; Amazon runs it on its computers, saving time and money.
  • A cookbook with ready-to-use recipes helps you get started quickly.

Why It Matters

Businesses can now fine-tune AI models faster and cheaper, without needing a team of infrastructure experts.

📬 Get the top 10 AI stories daily