Back to projects
CloudData Science

CloudEco — Wildlife Detection API

Cloud-native ML inference with YOLOv8, FastAPI, Docker, Kubernetes & Terraform

Built and deployed a cloud-native wildlife detection REST API powered by a YOLOv8 model, FastAPI, Docker, Kubernetes, Terraform, and structured load testing.

PythonYOLOv8FastAPIDockerKubernetesTerraformLocustCloud InfrastructureML Deployment

Problem

Wildlife monitoring workloads needed a scalable, reproducible way to run object detection inference on cloud infrastructure without manual provisioning.

My role

Cloud / ML Engineer — designed the inference API, container strategy, Kubernetes manifests, Terraform stack, and load-testing harness.

Solution

Wrapped a YOLOv8 model in a FastAPI service, containerised with Docker, deployed to Kubernetes, and provisioned multi-node cloud infrastructure with Terraform. Locust scripts benchmarked latency, throughput, and reliability across configurations.

Challenges

  • ›Balancing inference latency against pod cost across replica counts.
  • ›Reproducible multi-node infrastructure across environments.
  • ›Benchmarking throughput and failure rate under structured load.

Key features

  • ›Deployed a cloud-native ML inference API under constrained cloud resource settings.
  • ›Provisioned multi-node cloud infrastructure using Terraform Infrastructure-as-Code.
  • ›Orchestrated containerised FastAPI services across Kubernetes deployments.
  • ›Conducted Locust load testing to benchmark throughput, response time, failure rate, and scalability.
  • ›Evaluated cloud performance using structured metrics including latency, concurrent traffic, and reliability.

Results

  • ›Documented performance envelope for capacity planning.
  • ›Reproducible Terraform-driven environments.
  • ›Structured load-test evidence for scalability claims.

Cloud-native ML inference

Benchmarked across pod counts

Reproducible IaC deployments