tech ramblings
  • Blog
  • Home
  • Search

Search tech ramblings

gpu


Early adventures with Ray on Kubernetes (kuberay) and LLM

 Posted on 2023-11-11  |  4 minutes  |  

Ray is a distributed framework for scaling applications. However, my journey started with Kuberay which is an operator and various CRDs such as RayCluster and RayService to provide a more declarative k8s native experience for Ray. [Read More]
k8s  kubernetes  ray  llm  llama2  gke  kuberay  rayservice  raycluster  gpu  accelerators 

 • © 2023  •  tech ramblings

Hugo v0.120.4 powered  •  Theme Beautiful Hugo adapted from Beautiful Jekyll

    Content posted here do not reflect the views of any commerical or organizational entity, they are of my opinion and mine only.