Overview
Functional Focus: Data Engineering, Real-Time Streaming, and HPC Job Orchestration Scientific Data Architecture: Design crash-safe, binary data formats capable of handling high-speed incremental writes from compute jobs and concurrent reads for query-time calculations. Operational Data Modeling: Design and maintain a relational database schema via an async ORM, backend-agnostic across database engines. HPC Workload Management: Manage the lifecycle of batch and interactivecompute jobs, handling subprocess monitoring, status polling, and cluster filesystem coherency. Real-Time API & Streaming: Build async backend services and long-lived, server-pushed event channels with backpressure handling, and enforce role-based access control on all APIs. AI Service Integration: Integrate and orchestrate calls to an AI/analytics service from the backend, coordinating with application state. Requiremen
Full job description
Description
Full Job Description
Functional Focus: Data Engineering, Real-Time Streaming, and HPC Job Orchestration
- Scientific Data Architecture: Design crash-safe, binary data formats capable of handling high-speed incremental writes from compute jobs and concurrent reads for query-time calculations.
- Operational Data Modeling: Design and maintain a relational database schema via an async ORM, backend-agnostic across database engines.
- HPC Workload Management: Manage the lifecycle of batch and interactivecompute jobs, handling subprocess monitoring, status polling, and cluster filesystem coherency.
- Real-Time API & Streaming: Build async backend services and long-lived, server-pushed event channels with backpressure handling, and enforce role-based access control on all APIs.
- AI Service Integration: Integrate and orchestrate calls to an AI/analytics service from the backend, coordinating with application state.
Requirements
Mandatory:
- Python 3, async/await
- FastAPI (or similar async Python web framework)
- Relational DB modeling, async ORM (e.g. Tortoise, SQLAlchemy), SQL
- Server-Sent Events or WebSockets, backpressure handling
- Role-based access control (RBAC), token-based auth (JWT/OAuth)
- Subprocess management, batch job lifecycle/status polling
- Binary/streaming file format design, crash-safe writes
- REST/SDK integration with an external AI/LLM service
Optional:
- Go or another async-capable backend language
- GraphQL
- PostgreSQL administration, Alembic/migrations tooling
- Message queues/brokers (Redis, RabbitMQ, Kafka)
- Air-gapped/offline deployment experience
- HPC schedulers (SLURM, PBS), Linux cluster filesystems
- NumPy/columnar formats (Parquet, HDF5)
- Tool-calling / function-calling orchestration patterns
Benefits
We offer great career growth, ESOPs, Gratuity, PF and Health Insurance.
Qualifications And Requirements
Mid-Senior level
Requirements & qualifications
Mid-Senior level
Tips for this job
Practical Job and Scholarship guidance. These tips do not replace official rules or create new eligibility requirements.
- Tailor the CV and application to the responsibilities and required skills stated on the official employer page.
- Use concrete evidence of relevant work, projects and measurable results rather than generic claims.
- Confirm location, work authorization, remote restrictions and sponsorship terms before applying.
- Apply through the original employer or official recruitment destination shown on this page.
Verification notes
Discovered directly from the employer’s public Workable account endpoint with details=true where supported. Public description, responsibilities, requirements and benefits were normalized into complete candidate-facing sections. Complete structured details were extracted from the public authoritative source while preserving the original application link.
Job and Scholarship is the discovery and verification layer. Confirm eligibility, dates, salary/funding and application instructions on the original source before submitting anything.
Astrome Technologies Careers ↗Browse current Job and Scholarship listings from Astrome Technologies Careers →
