Data, Databases & Streaming

Relational & NoSQL databases, search, caches, streams, ETL/ELT, and analytics stacks.

  • 7 Subtopics
  • 15 Tracked terms
  • Last 30 days Feed window
Search within this topic Ask AI about this topic All topics

Inside Data, Databases & Streaming

Relational (SQL) Postgres/MySQL/SQLite tuning, HA/DR, indexing, and query planning. NoSQL & NewSQL Document, key-value, columnar, search, and distributed SQL engines. Search & Relevance Engineering Full-text search, ranking, synonyms, vectors, and hybrid retrieval patterns. Caching & Edge Data KV stores, CDNs, edge runtimes, and latency-first data patterns. Streaming & Queues Event streaming, pub/sub, backpressure, and consumer groups at scale. ORMs & Migrations Type-safe models, schema diffs, seed data, and multi-tenant strategies. Data Engineering & Analytics Pipelines, orchestration, dbt, warehouses, BI, and governance/lineage.

What this topic collects on

An article joins this feed when it matches these terms. Each one is also a search of its own.

Latest in Data, Databases & Streaming


snowflake.com > en > blog > engineering > understanding-hybrid-table-bulk-insert

Understanding Hybrid Table Bulk INSERTs

1+ hour, 35+ min ago   (447+ words) With our release of Hybrid Table Bulk INSERT, we are bringing the faster performance of Optimized Bulk Loads to more INSERT queries, achieving up to 10x faster batch INSERTs.[0] Hybrid Tables leverage a row store as the primary data store to…...


dev.to > artsensiva > five-results-i-spent-time-proving-splines-dont-help-trajectory-databases-2194

Five results: I spent time proving splines don't help trajectory databases

52+ min ago   (1573+ words) If you work with GPS tracks, this idea shows up sooner or later: why store a trajectory as a polyline of thousands of points when a vehicle moves smoothly? Accelerate, turn, brake — that's a smooth curve. A cubic B-spline describes…...


blogs.oracle.com > autonomous-ai-database > turn-any-sql-query-into-an-oci-monitoring-metric-from-inside-autonomous-ai-database

Turn Any SQL Query Into an OCI Monitoring Metric — From Inside Autonomous AI Database

3+ hour, 42+ min ago   (1158+ words) Information, tips, tricks and sample code for data management in an autonomous, cloud-native, data-driven world No agent. No function. No compute instance. Just a SELECT and a scheduler job. Autonomous AI Database gives you more than forty metrics in OCI…...


dev.to > shaqmk > bridging-local-and-cloud-databases-for-centralized-data-management-110e

Bridging Local and Cloud Databases for Centralized Data Management

2+ hour, 4+ min ago   (276+ words) Introduction Structured data (typically in rows and columns) resides in databases such as... Tagged with postgres, dbeaver, aiven, powerbi....


dev.to > cyberttopic > the-same-corpus-told-me-two-different-things-and-only-one-of-them-was-checkable-4ffb

My knowledge base missed a contradiction. My content graph found it in one query

2+ hour, 36+ min ago   (1433+ words) This is a submission for the Sanity Challenge, Path One: Ship an Agent That Queries Real Content... Tagged with devchallenge, sanitychallenge, sanity, ai....


dev.to > david_mwandairo_777f888b4 > subqueries-and-ctes-asking-a-question-inside-a-question-3lpk

Subqueries and CTEs: Asking a Question Inside a Question

2+ hour, 55+ min ago   (624+ words) Some questions can't be answered in one pass. "Which hive produced the most honey?" needs the maximum honey figure before it can find the hive that matches it. "Which keepers are above average?" needs the average before it can compare…...


dev.to > shadowsaurus > finops-meets-architecture-tiering-clickhouse-from-ebs-to-s3-without-touching-a-query-21d9

FinOps Meets Architecture: Tiering ClickHouse from EBS to S3 Without Touching a Query

4+ hour, 35+ min ago   (1421+ words) Run ClickHouse on EC2 long enough and you'll hit the same moment everyone does. The queries are fast, the ingestion pipeline is humming, and then someone opens the AWS bill and asks why storage alone costs more than the instance. The…...


dev.to > bijan53c > encryption-isnt-enough-you-also-need-to-know-if-someone-tampered-with-your-data-gio

Encryption Isn't Enough — You Also Need to Know If Someone Tampered With Your Data

4+ hour, 57+ min ago   (313+ words) Most people think encryption's job is to keep data secret. That's only half the job — and the half it doesn't cover is exactly where a lot of otherwise-careful implementations quietly break. This is part 4 of a series documenting what I'm…...


medium.com > @resultity > mountday-7-four-ways-we-made-resultity-simpler-without-making-it-smaller-d1356ddf7267

Mountday #7: Four Ways We Made Resultity Simpler Without Making It Smaller

1+ hour, 35+ min ago   (934+ words) For the last two weeks, some of the best Resultity work did not look like adding features. We were already deep enough into …...


dev.to > sufyanism > why-fork-doesnt-duplicate-memory-copy-on-write-and-the-page-table-3ioa

Why fork() Doesn't Duplicate Memory: Copy-on-Write and the Page Table

6+ hour, 19+ min ago   (24+ words) Calling fork() does not duplicate a process's memory space; it copies the page table hierarchy and... Tagged with programming, kernel, code, devops....