Database as Filesystem
Peter Chubb
https://2019.linux.conf.au/schedule/presentation/212/
Most network file systems are either a layer over an existing filesystem (NFS, CIFS), or are develped from scratch to have separate, replicated, purpose-designed databases for metadata and object store (GFS, Glusterfs). At the same time, most database engines provide (or can be coerced into providing) replication and all the ACID properties needed for a high-performance filesystem.
Idea: Use a database engine (Postgres, MariaDB) on raw partitions with a fast separate nVME log file; build POSIX file system semantics on top. It's pretty obvious that this could work; I'm just starting to implement it so performance and durability can be measured.
linux.conf.au is a conference about the Linux operating system, and all aspects of the thriving ecosystem of Free and Open Source Software that has grown up around it. Run since 1999, in a different Australian or New Zealand city each year, by a team of local volunteers, LCA invites more than 500 people to learn from the people who shape the future of Open Source. For more information on the conference see https://linux.conf.au/
#linux.conf.au #linux #foss #opensource
Видео Database as Filesystem канала linux.conf.au
https://2019.linux.conf.au/schedule/presentation/212/
Most network file systems are either a layer over an existing filesystem (NFS, CIFS), or are develped from scratch to have separate, replicated, purpose-designed databases for metadata and object store (GFS, Glusterfs). At the same time, most database engines provide (or can be coerced into providing) replication and all the ACID properties needed for a high-performance filesystem.
Idea: Use a database engine (Postgres, MariaDB) on raw partitions with a fast separate nVME log file; build POSIX file system semantics on top. It's pretty obvious that this could work; I'm just starting to implement it so performance and durability can be measured.
linux.conf.au is a conference about the Linux operating system, and all aspects of the thriving ecosystem of Free and Open Source Software that has grown up around it. Run since 1999, in a different Australian or New Zealand city each year, by a team of local volunteers, LCA invites more than 500 people to learn from the people who shape the future of Open Source. For more information on the conference see https://linux.conf.au/
#linux.conf.au #linux #foss #opensource
Видео Database as Filesystem канала linux.conf.au
Показать
Комментарии отсутствуют
Информация о видео
Другие видео канала
Booting fasterWriting Viruses for Fun, not ProfitThe Tragedy of systemdBut Mummy I don't want to use CUDA - Open source GPU computeGoogle File System - Paper that inspired HadoopA case study in incrementing a language's major version: PHP"Uptime 15,364 days - The Computers of Voyager" by Aaron CummingsNYLUG Presents: Lennart Poettering -on- Systemd in 2018How to Disappear CompletelyDoes making the kernel harder make making the kernel harder?systemd - The Good PartsFPGA based mobile phone: Creating a truly open and trustable mobile communications deviceLinux File System/Structure Explained!My year on the front line - cleaning infected sitesMaking C Less Dangerous in the Linux kernelFirmware security, why it matters and how you can have itThe AV1 Video Codec"NTFS really isn't that bad" - Robert Collins (LCA 2020)Tutorial: Building the Simplest Possible Linux System - Rob Landley, se-instruments.com