TAGAll tags →
Database.
12 posts — Posts about Database
11
Exporting Hundreds of Millions of MySQL Rows to Excel
A production design for exporting massive list data from a SaaS system to Excel: MQ-based load leveling with async consumers, read replicas to absorb query pressure, id-cursor pagination with EasyExcel spilling to disk and uploading to OSS — 75.5 million rows exported in about 20 minutes.
2020.01.164 MIN
12Paginating Hundreds of Millions of Rows in MySQL
Once a table grows to millions of rows, plain limit-based pagination gets slower with every page. Notes from optimizing pagination on a billing table: locating primary keys with a subquery, deferred joins, and verifying with explain to bring deep pagination down to acceptable latency.
2020.01.157 MIN