Concurrent File I/O in Python: Faster File I/O With Threads, Processes, and AsyncIO

SuperFastPython.com
Ebook
422
Pages
Eligible

About this ebook

File I/O can be faster in Python when using concurrency.


* Discover how to write files 3x faster with processes

* Discover how to read files 3x faster with processes and threads

* Discover how to unzip files 4x faster with processes and threads


File I/O stands for File Input/Output, referring to the process of reading data from and writing data to files on a storage device like a hard drive.


Studying how to bring concurrency to file I/O is critical for Python developers. Adding concurrency into your file I/O tasks, you can unlock the full potential of modern computer hardware, making your applications more efficient and capable of handling large workloads.


The problem is, there is no silver bullet. Each program and each task is different and unique. We cannot know which approach to Python concurrency will give good or even the best performance.


Therefore in addition to learning how to perform file I/O operations concurrently, Python developers must learn how to benchmark a suite of different approaches to implementing file I/O operations concurrently.


Introducing: "Concurrent File I/O in Python". A new book designed to teach you how to bring concurrency to your file I/O tasks in Python, super fast!


You will get rapid-paced tutorials showing you how to bring concurrency to the most common file I/O tasks.


Including:


* How to perform file I/O operation in the background.

* How to concurrently read files from disk and write files to disk.

* How to concurrently delete files from disk.

* How to concurrently copy, move, and rename files on disk.

* How to efficiently append files on disk.

* How to concurrently zip files and unzip files on disk.


Don't worry if you are new to file I/O or concurrency, you will also get primers on the background required to get the most out of this book, including:


* The importance of concurrency for high-performance file I/O.

* How to perform common file I/O operations in Python.

* How to use Python concurrency APIs including threading, multiprocessing, and asyncio.

* How to perform file I/O with coroutines in asyncio using the aiofiles library.

* How to use programming patterns for concurrent file I/O.


Each tutorial is carefully designed to teach one critical aspect of how to bring concurrency to file I/O tasks.


Stop copy-pasting code from StackOverflow answers.


Learn Python concurrency correctly, step-by-step.

About the author

Jason Brownlee, Ph.D. helps Python developers bring modern concurrency methods to their projects with hands-on tutorials. Learn more at https://SuperFastPython.com

Jason is a software engineer and research scientist with a background in artificial intelligence and high-performance computing. He has authored more than 20 technical books on machine learning and has built, operated, and exited online businesses.

Rate this ebook

Tell us what you think.

Reading information

Smartphones and tablets
Install the Google Play Books app for Android and iPad/iPhone. It syncs automatically with your account and allows you to read online or offline wherever you are.
Laptops and computers
You can listen to audiobooks purchased on Google Play using your computer's web browser.
eReaders and other devices
To read on e-ink devices like Kobo eReaders, you'll need to download a file and transfer it to your device. Follow the detailed Help Center instructions to transfer the files to supported eReaders.