I wrote a blog post about running coding assistants on your own infrastructure. It will be useful but not as much as Claude3.7 - and it costs ten times more.
https://davidgrajal.com/2025/03/24/202502_vllm_coding/
I wrote a blog post about running coding assistants on your own infrastructure. It will be useful but not as much as Claude3.7 - and it costs ten times more.
https://davidgrajal.com/2025/03/24/202502_vllm_coding/
Setup ComfyUI from Scratch & Run Flux Diffusion Model on RunPod – Step by Step!
Want to set up ComfyUI for seamless AI image generation? This tutorial covers everything—from ComfyUI installation, RunPod setup, Flux Schnell model integration, to Hugging Face model downloads. Follow the step-by-step guide with ready-to-use commands and get started with AI-powered creativity today!
Read the full guide here: https://mobisoftinfotech.com/resources/blog/flux-on-runpod-using-comfyui
Last week I used #Replicate to crunch through the #GLAMhack projects as my physical hardware (what do you mean you didn't bring GPUs to a hackathon... ) was not cooperating - but for more code-level data science work #Runpod is proving excellent here at the #EnergyDataHackdays
here is my referral link: https://runpod.io/?ref=yqg82xxd
Out early for a Goal Pace run as part of my training for the #GreatSouthRun in October, and a great start to the day
I'm fundraising for UK Sepsis Trust. Check out my Just Giving page and please donate if you can. Thank you! #JustGiving https://www.justgiving.com/page/swinders-sepsis-gsr2024
#garmin #beatyesterday #therunningcommunity
#redfoxrunclub #teamr40plus #running #therunningchannel #runpod #runpodrunclub
The V3 update adds video-to-video functionality. For those interested in using LivePortrait but lacking a powerful GPU, using a Mac, or preferring cloud-based solutions, this tutorial is ideal. It guides you through one-click installation and usage of LivePortrait on #MassedCompute, #RunPod, and free #Kaggle accounts. After this tutorial, you'll find cloud-based LivePortrait as easy to use as a local installation. https://youtu.be/wG7oPp01COg
How to Use SwarmUI & Stable Diffusion 3 on Cloud Services Kaggle (free), Massed Compute & RunPod
Стартап RunPod, що спеціалізується на інфраструктурі штучного інтелекту, залучив значне початкове фінансування у розмірі 20 мільйонів доларів США від Dell Technologies Capital та Intel Capital.
#AI #RunPod #Фінанси #Хмарнітехнології #ШІ
https://thetransmitted.com/ai/dell-ta-intel-pidtrymaly-hmarnu-platformu-runpod-na-20-mln/
At the moment I am translating lyrics. Running it locally to translate non-English lyrics I get a response time of anywhere around 60 seconds per lyric. on the #runpod around 5 seconds.
My hardware is a #minisforum with 32 gb memory, no gpu.
Only weirdness I notice that it translated 'zonde' (in this context meaning 'a waste' as 'sinful'
2nd day I am running #ollama on a #runpod pod.
Not that hard to set up (once you know)
1) create a pod of your liking (but it should be a gpu pod) I used the latest RunPod Pytorch as a template 2.2.10
2) add port 11434 to exposed ports
3) add OLLAMA_HOST: 0.0.0.0
4) Start it up and ssh into it
(assuming you have the keys added as needed.
5) run the install script from https://ollama.ai
6) ollama serve &
7) ollama pull [the models you want]
If you like true Open AI you should check out Basaran project :)
I gave something to help people run it in easy way using RunPod service so anyone can run it.
https://github.com/hyperonym/basaran/issues/58
#opensource #ai #openai #RunPod