Expand description
Parallel file processing utilities.
This module provides high-performance parallel processing of multiple audit log files using Rayon for CPU-bound workloads. Files are processed concurrently with proper progress tracking and error handling.
Structs§
- File
Process Result - Result of processing a single file
Functions§
- count_
file_ lines - Count lines in a file for progress tracking (lightweight)
- process_
file_ streaming - Process a file with streaming to minimize memory usage
- process_
files_ aggregate - Process multiple files with simple aggregation (sum, count, etc.)
- process_
files_ parallel - Process multiple files in parallel with memory-efficient streaming