Profile avatar
techhpc.bsky.social
We're the HPC Engineering team from AWS, and we publish stuff about running R&D workloads in the cloud. Follow us here, and on YouTube (hpc.news/techshorts), too.
68 posts 696 followers 695 following
Prolific Poster

AWS Parallel Computing Service now supports AWS CloudFormation, enabling you to deploy and scale HPC workloads as code. Check out our open-source HPC Recipes Library for quick cluster deployments. #HPC https://buff.ly/4hetshj

Caris Life Sciences accelerated their genomic data processing from months to just 2.5 days using AWS services like Batch, ECS, and Spot Instances. Learn how they achieved this remarkable feat in our latest blog post. https://buff.ly/4hgzIVQ

The Call for Proposals is open for the innaugural HPSF Conference in Chicago in May. Details here: https://buff.ly/3EfqpGS - please come along and help us build this community into something stronger and ever more sustainable.

What if you could simulate ball impacts in the blink of an eye? Our new blog post reveals how advanced ML models are transforming transient response prediction for safer, more resilient products. https://buff.ly/3E40DFo

In May the HPSF is holding it's first ever community meeting to bring the brightest minds in HPC software together. It's dedicated to advancing community-driven solutions for performance, portability, and productivity for our whole community. Details here: https://buff.ly/4gYiood - Join us!

Cryo-EM data processing just got easier! Learn how AWS Parallel Computing Service can help structural biologists scale their HPC infrastructure for Cryo-EM research. #CryoEM #AWS #HPC https://buff.ly/3Wc9co4

It’s been a big year in the HPC team at AWS. I’m awed by all of you who’ve invented new things to solve hard problems - it’s my reason to get up every morning. I’m spending the holidays working on some personal projects. Hope you do whatever brings you joy. And rest. Much peace and love folks.🌈🎅❤️

The changes to auth and identity options in this new release of RES are pretty significant too. We’ll have more to say about all this in the new year. But this is neat stuff.

This is a big deal. Full CloudFormation support for Parallel Computing Service is live & HPC Recipes updated (thanks Matt Vaughn). The future has definitely arrived. This is how HPC should be done.

Explore how Research and Engineering Studio on AWS (RES) enables admins to build Trusted Research Environments (TREs) with built-in security and compliance controls. Learn more in our latest blog post. https://buff.ly/3VLXZKz

Curious about running AI-powered protein folding analyses on AWS? Quantori's new solution makes it easy to test generative models and visualize results in your own cloud environment. https://buff.ly/49JMOYr

With $22B in assets under management, BAM needed an effective solution to empower their 160 investment teams. Learn how they harnessed AWS Batch and Amazon EKS to push the boundaries of financial research. https://buff.ly/3BmVDL6

Discover how AWS Batch's multi-container features enable large-scale AV/ADAS simulations with the IPG CarMaker simulator. Learn about the challenges of integrating complex, interdependent vehicle systems. https://buff.ly/3Br6R1g

Congratulations to the 5 winning teams of the Airbus and BMW Group Quantum Computing Challenge! Their innovative proposals tackled real-world industry use cases demonstrating the transformative potential of quantum computing. Read more about their groundbreaking work. https://buff.ly/3ZLAhjP

Fidelity and AWS have teamed up to put their brains together and create a Combinatorial Brain Surgeon (iCBS) to operate on AI models. This innovative pruning algorithm is just what the doctor ordered for your large-scale AI needs. Check out our latest post for the diagnosis. https://buff.ly/3OIVTY2

Looking to boost storage performance for your #HPC workloads on AWS? Find out how to build a high-speed EC2 cache for under $4/hour that's fit for purpose in this new blog post. https://buff.ly/3ZnNqhI

The future is hybrid quantum-classical computing. Find out how NVIDIA and Amazon are teaming up to advance hybrid quantum workflows. #QuantumComputing https://buff.ly/49gb1p2

LLMs are scaling exponentially. Learn how advanced technologies like Triton, TRT-LLM and EKS enable seamless deployment of models like the 405B parameter Llama 3.1. Let's go large. https://buff.ly/49fOwAy

If you love HPC but you also want to reduce the carbon footprint for your workloads, please join us at #AWSreInvent for a talk abotu exactly how to do that. Repeated over two days, at 3 different times - don't miss this https://buff.ly/4gb2iab #HPC #Sustainability #CloudComputing #BuildOnAWS

On your way to re:Invent 2024? Don't miss the workshops, chalk talks, and breakout sessions our HPC Nerds are putting on. In particular, if you're looking to get hands-on with AWS Parallel Computing Service (our newest kid), the workshop is on Monday (CMP409) - check the attached guide.

The hpc.social projects do have some small but noticeable costs to maintain our services. With "giving Tuesday" coming up it's a good time for the #HPC community to help support these costs. Thanks to our current sponsors listed at github.com/sponsors/hpc... and at hpc.social/sponsors/. Chip in now!

The one where the Vanessasaurus screams "I want my cluster sooner than that". We don't mind if you're impatient. We are too. www.youtube.com/watch?v=LJh-...

A couple of weeks on #BlueSky and I already have more followers here than after 2+ years on #Mastodon An indication of how quickly the #HPC community seems to be flocking here Realistically it will take time to get to Twitter levels, but definitely an encouraging start #SC24 helped!

If you watched any of our live builder sessions last week in Atlanta at SC'24, you'll be happy to know that we've put a lot of technical material about each session (including recipes, tutorials, and blog links) on our day1 site for you to use at home. It's all here: https://buff.ly/3V91gDg

Quantum computing promises to revolutionize industries. Our new Quantum Embark program provides expert guidance to help you harness its potential. https://buff.ly/410w8K3

Congrats to everyone who survived #SC24. See you next year for ‘25.

If you're leaving SC'24 inspired by what you saw, and you want to just get started playing with something new, then you can watch this latest Tech Short which shows you how to spin up an AMD cluster in 15 mins, with Lustre, MPIs + stuff you care about. Ready to break things. https://buff.ly/4fY2JnV

If you're at SC'24. ponder swinging by the AMD booth and hearing Raymond and Dnyadesh show how easy it it to spin up an AMD-based cluster using our new Parallel Computing Service. We even have a handy recipe to do it all in one-click. Anyhow, AMD Booth (#2731) today at 1pm. #SC24 #HPC #AWS

AWS is investing in researcher training with new learning plans for HPC, quantum, stats, AI/ML & generative AI. Check out the details! https://buff.ly/4hYU7Q0

I'm hiring #HPC I don’t want a cover letter, or a CV. We don’t do LeetCode 🤮, we don’t have ten stage interview process or 6hr coding assignment. Just make sure your LinkedIn profile is up to date. There is a catch though

Clearly we’re doing something right, but there’s still something terribly wrong with this picture (clue: it’s the model). Nonetheless, united in our cardboardiness. We’re trying hard to be the best cloud for HPC we can, but if you have ideas about how we can do better, let me know.

Hey peeps from #WHPC at #SC24. I can't be there tonight for the reception, but I'm there with you in spirit, and in cardboard. My friend Carina is going to be representin', tho, so you got a better deal -)

If you're at SC24, drop by to the HPSF booth (#4641) and say hi to the team there. HPSF is working to put critical HPC open-source projects on a sustainable footing, with support from companies, and research groups all over the world. But we all need your help and involvement to make that possible.

If you just watched the RES + PCS talk @ our AWS booth at SC24, you'll be happy to know that the details of how to implement this (with an easy recipe) are all in this new blog post. Running stuff just got easier for the R&D teams. That's our mission. https://buff.ly/490Dq2A

Maximize computational speed securely. Our latest blog explores high-performance computing on AWS using NIST's architecture, threat analysis, and security recommendations. Get the details! https://buff.ly/3CBpMqi

Huge props to the EESSI team for winning a Reader's Choice Award. We're glad to be able to support projects like these, because this is where great software, and great ideas are born. Anything that makes it easier (well, EESSI'er) to get your hands on what you need - well, we're fans.

Yes, we innovate things for a living - it's what we do. But it helps to pause and think about *why*. Why we wake up, and often work late: Passion for an outcome that matters to all of us. This is *why* I'm in #HPC. It's the Highly Passionate Crew. And proudly so. youtu.be/yt3OC0miEzE

We'll have some news to share about one of our favorite things tonight during the gala opening. Hope you can make it. Booth #2501.

I realize there's a lot of partying ^H^H^H^H^H 'networking' happening at SC, but don't forget our 'networking event' with our friends from NVIDIA tomorrow evening. If you go, you'll get NERD HATS. Yes, really. In case someone 40 feet away can't tell. Must register. https://buff.ly/3Za0Fnn

If you have a meeting with AWS at SC'24, here's a handy map to find the fastest path to the Hilton Garden Inn (where we have coffee waiting for you). https://buff.ly/49c5rnX And if you don't have a meeting with us, but want to, you can ask for one here: https://buff.ly/4evlGx3

There's a lot going on at SC'24 this week. But if you want to chat with one of our AWSome partners at our booth, you can start by bookmarking this page, and using the calendar items for their sessions, so you don't forget when and where to meet them. It's all at day1hpc.com/sc24apn/