Course Objective & Scope
IoT sensors, financial market ticks, smart meters and infrastructure telemetry generate relentless streams of append-only timestamped records. Stored in standard relational tables, this volume quickly overflows B-Tree indexes out of RAM, collapses insert throughput and drives up storage bills.
This course covers time-series workload characteristics, hands-on architecture and querying with TimescaleDB (hypertables, chunk sizing, columnar compression, continuous aggregates) alongside purpose-built engines (InfluxDB 3 / VictoriaMetrics / QuestDB), preventing high-cardinality explosions, time-windowed analytics (time_bucket, ASOF JOIN, gapfilling), and automated downsampling and retention tiers.
Who Should Attend?
- Backend and data engineers building IoT, telemetry, energy, industrial (IIoT) or financial market platforms
- DevOps, SRE and platform engineers designing metric storage and observability backends
- Database teams struggling with slow queries and runaway storage costs on timestamped tables
- Prerequisite: working knowledge of SQL and core database concepts
Key Takeaways
- Choose objectively between PostgreSQL-based TimescaleDB and purpose-built engines (InfluxDB, VictoriaMetrics, QuestDB)
- Model tags/metadata vs fields/metrics properly to prevent high-cardinality index bloat
- Configure TimescaleDB hypertable chunk intervals, native columnar compression and Continuous Aggregates
- Write expressive time-series queries with
time_bucket, gapfilling/LOCF interpolation andASOF JOIN - Automate multi-tier downsampling (rollups) and chunk-drop retention policies
Curriculum
Time-Series Workloads and TSDB Architectural Comparison
- Characteristics of time-series data: append-heavy ingestion, recency-biased reads and lifecycle ageing
- Why standard B-Tree indexes struggle at scale, and how time-chunking and columnar/TSM engines solve it
- Decision matrix: TimescaleDB, InfluxDB (v2 vs v3 Apache Arrow/Parquet), VictoriaMetrics and QuestDB
Schema Modelling, High Cardinality and High-Throughput Ingestion
- Narrow vs Wide table schemas and joining relational device/asset metadata
- Understanding High Cardinality: why unbounded IDs in indexed tags blow up memory
- Batch sizing, handling out-of-order / late-arriving samples and ingestion backpressure
TimescaleDB: Hypertables, Columnar Compression and Time Analytics
- Creating Hypertables, sizing
chunk_time_intervalto fit active chunks in RAM, and composite indexes - Time-series hyperfunctions:
time_bucket,time_bucket_gapfill,locf,interpolate,first()/last()and candlesticks - Hybrid row/columnar storage: configuring
segmentbyandorderbyfor 90%+ compression on aged chunks
The InfluxDB / VictoriaMetrics Ecosystem and Telemetry Queries
- Measurements, Tag Sets, Field Sets, Timestamps and ingesting via Line Protocol
- Querying with InfluxDB 3 (SQL/InfluxQL) and PromQL/MetricsQL for rates, derivatives and percentiles
- Ingestion pipelines with Telegraf, OpenTelemetry Collector and Kafka consumers
Continuous Aggregates, Downsampling and Retention Policies
- Accelerating Grafana dashboards with real-time incremental Continuous Aggregates
- Multi-resolution rollups (e.g. 7-day raw data, 90-day 1-minute rollups, 2-year hourly summaries)
- Instantaneous data expiry via
drop_chunksand automated retention policies instead of expensive DELETEs
Other Courses in This Category
-
Vector Databases, ANN Indexing and Hybrid Search Architecture
Dense and sparse embeddings, distance metrics, ANN index algorithms (HNSW, IVF, DiskANN), vector quantization (PQ, Scalar, Binary), metadata filtering, hybrid search and recall/latency benchmarking.
- Live Course
- 5 modules
-
Practical Vector Search with pgvector, Milvus, Weaviate and Pinecone
Hands-on engineering across the four leading vector platforms: indexing, hybrid search, multi-tenant isolation and architectural selection with PostgreSQL pgvector, Milvus, Weaviate and Pinecone.
- Live Course
- 5 modules
-
Database Performance Tuning and SQL Query Optimization
Cost-Based Optimizer internals, reading Execution Plans, SARGability, B-Tree/Covering/Filtered index design, join algorithms, parameter sniffing, lock/isolation analysis and partitioning — for developers and DBAs.
- Live Course
- 5 modules
-
Oracle PL/SQL Database Programming and Performance
PL/SQL block structure, cursors, modular Package design with procedures and functions, enterprise exception handling, triggers, dynamic SQL and high-volume processing with FORALL and BULK COLLECT.
- Live Course
- 5 modules
-
Relational Data Modelling, SQL Normalization and Schema Optimization
Conceptual/logical/physical data modelling, 1NF–3NF/BCNF normalization rules, preventing data anomalies, controlled denormalization, natural vs surrogate keys, constraints and zero-downtime schema evolution.
- Live Course
- 5 modules
-
SQL Querying Fundamentals
Foundational SQL Server course covering relational database concepts, data modeling, normalization, indexing, database objects (Tables, Views, Stored Procedures), and JOIN queries.
- Live Course
- 8 modules
Get in touch