How Rocket Companies modernized their data science solution on AWS
In this post, we share how we modernized Rocket Companies’ data science solution on AWS to increase the speed to delivery from eight weeks to under one hour, improve operational…
Amazon EC2
Large language model inference over confidential data using AWS Nitro Enclaves
This post discusses how Nitro Enclaves can help protect LLM model deployments, specifically those that use personally identifiable information (PII) or protected health information (PHI). This post is for educational…
Introducing three new NVIDIA GPU-based Amazon EC2 instances | Amazon Web Services
Amazon Elastic Compute Cloud (Amazon EC2) accelerated computing portfolio offers the broadest choice of accelerators to power your artificial intelligence (AI), machine learning (ML), graphics, and high performance computing (HPC)…
Amazon EC2 DL2q instance for cost-efficient, high-performance AI inference is now generally available | Amazon Web Services
This is a guest post by A.K Roy from Qualcomm AI. Amazon Elastic Compute Cloud (Amazon EC2) DL2q instances, powered by Qualcomm AI 100 Standard accelerators, can be used to…
Enable pod-based GPU metrics in Amazon CloudWatch | Amazon Web Services
This post details how to set up container-based GPU metrics and provides an example of collecting these metrics from EKS pods.