Recalculate Blob Store Storage Task Performance Testing
Recalculate Blob Store Storage Task Performance Testing
In Sonatype Nexus Repository 3.69.0, we introduced the Repair - Recalculate blob store storage task that calculates the total space occupied by blobs in a blob store. We are providing the performance testing information below to help you appropriately plan and allocate resources for using this task.
Environment Configuration
The performance testing environment for testing the Repair - Recalculate blob store storage task included the following:
- m5d.2xlarge EC2 Instance
- An S3 bucket used to store assets
- A Gatling script used to populate assets
- Blob store containing 6 million blobs
Collected Data
Sonatype collected the following findings when running the Repair - Recalculate blob store storage task for 7 hours:
- Task processes ~11 blobs per second
- After 7 hours, the task had counted ~280,000 blobs
- Processing speed was consistent throughout entire test duration
Conclusions and Performance Projections
The Repair - Recalculate blob store size task runs at a constant processing rate. Based on test results, the estimated processing times are:
- 5 million blobs: approximately 126 hours (5.2 days)
- 20 million blobs: approximately 505 hours (21 days)
Given the lengthy processing time for running this task, it may not be appropriate for very large blob stores.
Note
You cannot stop the task once it starts.
The blob count and used size update continuously while the task runs. Values may appear inaccurate until the task completes.