Michael Vrable [Fri, 18 Mar 2011 08:24:42 +0000 (01:24 -0700)]
Prepare for another run of the synthetic read benchmark
Michael Vrable [Fri, 18 Mar 2011 07:08:33 +0000 (00:08 -0700)]
Fix another cleaner bug
Michael Vrable [Fri, 18 Mar 2011 06:27:42 +0000 (23:27 -0700)]
Cleaner fix part 1
Michael Vrable [Fri, 18 Mar 2011 05:38:05 +0000 (22:38 -0700)]
Bug fix in the in-proxy cleaner component
Michael Vrable [Fri, 18 Mar 2011 04:18:53 +0000 (21:18 -0700)]
Check in the synthetic write benchmark results
Michael Vrable [Fri, 18 Mar 2011 04:18:12 +0000 (21:18 -0700)]
Dump some statistics when the cleaner runs
Michael Vrable [Fri, 18 Mar 2011 00:02:55 +0000 (17:02 -0700)]
Script for randomly writing files to generate work for a cleaner
Michael Vrable [Thu, 17 Mar 2011 21:26:45 +0000 (14:26 -0700)]
Re-run synthetic writes with different parameter values
Michael Vrable [Thu, 17 Mar 2011 18:54:50 +0000 (11:54 -0700)]
More bench fixes
Michael Vrable [Thu, 17 Mar 2011 18:45:25 +0000 (11:45 -0700)]
Benchmark fix--mount the file system to write to it
Michael Vrable [Thu, 17 Mar 2011 18:41:00 +0000 (11:41 -0700)]
More benchmark fixes
Michael Vrable [Thu, 17 Mar 2011 18:38:56 +0000 (11:38 -0700)]
Include elapsed time in write benchmark
Michael Vrable [Thu, 17 Mar 2011 18:35:06 +0000 (11:35 -0700)]
Synwrite benchmark setup
Michael Vrable [Thu, 17 Mar 2011 18:32:22 +0000 (11:32 -0700)]
Set up synthetic write benchmark.
Michael Vrable [Thu, 17 Mar 2011 17:26:38 +0000 (10:26 -0700)]
CIFS results
Michael Vrable [Thu, 17 Mar 2011 17:15:55 +0000 (10:15 -0700)]
Updates to synthetic read data processing script
Michael Vrable [Thu, 17 Mar 2011 17:12:28 +0000 (10:12 -0700)]
Add write throttling based on the size of the uncommitted journal
Previously, throttling was based only on data in memory not committed to
the journal. With limited upload bandwidth to the cloud, we need both.
Michael Vrable [Thu, 17 Mar 2011 17:12:09 +0000 (10:12 -0700)]
Merge git+ssh://idril.vpn.vrable.net/home/mvrable/local/bluesky
Michael Vrable [Thu, 17 Mar 2011 10:12:14 +0000 (03:12 -0700)]
Update write benchmark
Michael Vrable [Thu, 17 Mar 2011 09:59:19 +0000 (02:59 -0700)]
Create a simple tool for measuring latencies of write operations
There is no explicit sync, but NFS has an implicit one on file close()
which should be good enough for benchmarking.
Michael Vrable [Thu, 17 Mar 2011 07:01:40 +0000 (00:01 -0700)]
Add figures for synthetic read benchmark
Michael Vrable [Thu, 17 Mar 2011 04:54:37 +0000 (21:54 -0700)]
Add notes on using a traffic limiter for benchmarks
Michael Vrable [Thu, 17 Mar 2011 04:02:50 +0000 (21:02 -0700)]
Check in and clean up repository
Michael Vrable [Thu, 17 Mar 2011 02:38:01 +0000 (19:38 -0700)]
Prepare to fill in more synthetic read data points
Michael Vrable [Thu, 17 Mar 2011 00:00:37 +0000 (17:00 -0700)]
Prepare for re-run of synthetic test with more clients
Michael Vrable [Wed, 16 Mar 2011 22:20:09 +0000 (15:20 -0700)]
Error message fix
Michael Vrable [Wed, 16 Mar 2011 22:06:35 +0000 (15:06 -0700)]
Fix cache sizes for run
Michael Vrable [Wed, 16 Mar 2011 22:01:58 +0000 (15:01 -0700)]
Prepare for first real synthetic read benchmark
Michael Vrable [Wed, 16 Mar 2011 21:05:12 +0000 (14:05 -0700)]
synread script updates
Michael Vrable [Wed, 16 Mar 2011 20:46:01 +0000 (13:46 -0700)]
Try to improve parallelism of synreadbench warmup phase
Michael Vrable [Wed, 16 Mar 2011 20:39:49 +0000 (13:39 -0700)]
Benchmark setup
Michael Vrable [Wed, 16 Mar 2011 20:23:00 +0000 (13:23 -0700)]
Report average latency in synbench
Michael Vrable [Wed, 16 Mar 2011 20:13:58 +0000 (13:13 -0700)]
More benchmark setup
Michael Vrable [Wed, 16 Mar 2011 19:54:43 +0000 (12:54 -0700)]
Setup for the synthetic read benchmark
Michael Vrable [Wed, 16 Mar 2011 19:31:09 +0000 (12:31 -0700)]
Add a mode for warming up the proxy cache before a synthetic benchmark
Michael Vrable [Wed, 16 Mar 2011 18:56:55 +0000 (11:56 -0700)]
More work on the synthetic read benchmark
Michael Vrable [Wed, 16 Mar 2011 17:24:19 +0000 (10:24 -0700)]
Work on the synthetic read benchmark
Michael Vrable [Wed, 16 Mar 2011 15:37:29 +0000 (08:37 -0700)]
Include no read aggregation data in graph
Michael Vrable [Wed, 16 Mar 2011 15:16:12 +0000 (08:16 -0700)]
More SPECsfs runs
Michael Vrable [Wed, 16 Mar 2011 08:32:49 +0000 (01:32 -0700)]
Work on a tool for a synthetic read benchmark
Michael Vrable [Wed, 16 Mar 2011 02:50:36 +0000 (19:50 -0700)]
Add an option to disable aggregating reads in the proxy
This is for benchmarking purposes. It uses range requests but does not
delay submitting the reads (to wait for batching opportunities).
Michael Vrable [Wed, 16 Mar 2011 00:15:15 +0000 (17:15 -0700)]
Minor changes to graphs and benchmark control scripts
Michael Vrable [Wed, 16 Mar 2011 00:14:38 +0000 (17:14 -0700)]
Extract wall clock timestamp of each run when parsing sfsres files
Michael Vrable [Tue, 15 Mar 2011 20:13:33 +0000 (13:13 -0700)]
Benchmark results using more concurrent requests and no crypto
Michael Vrable [Tue, 15 Mar 2011 04:37:23 +0000 (21:37 -0700)]
SPECsfs results from repeating the Azure measurements
Michael Vrable [Tue, 15 Mar 2011 04:24:25 +0000 (21:24 -0700)]
Add an option to disable cryptographic operations
This is intended for benchmarking, to measure the overhead of just the
non-cryptographic operations.
Michael Vrable [Tue, 15 Mar 2011 03:56:08 +0000 (20:56 -0700)]
Speed up the deletion of all files in an Azure container
Michael Vrable [Tue, 15 Mar 2011 00:35:30 +0000 (17:35 -0700)]
NFS trace replay results
Michael Vrable [Mon, 14 Mar 2011 22:00:13 +0000 (15:00 -0700)]
Merge git+ssh://vrable1.sysnet.ucsd.edu/scratch/bluesky
Michael Vrable [Mon, 14 Mar 2011 21:40:44 +0000 (14:40 -0700)]
Revert "Enable real-time trace replay instead of maximum-speed replay mode."
This reverts commit
c0cab09e97b2c3fce55a743a978e4ea81b5ffbdb.
Michael Vrable [Mon, 14 Mar 2011 19:42:15 +0000 (12:42 -0700)]
Check in new benchmark results
Michael Vrable [Mon, 14 Mar 2011 16:48:14 +0000 (09:48 -0700)]
Plot updates
Michael Vrable [Mon, 14 Mar 2011 03:10:28 +0000 (20:10 -0700)]
Check in new Azure benchmark results
Michael Vrable [Sun, 13 Mar 2011 17:04:03 +0000 (10:04 -0700)]
SPECsfs results for the non-log-structured case
Michael Vrable [Sun, 13 Mar 2011 04:34:56 +0000 (20:34 -0800)]
Check in some of the recent SPECsfs results
Michael Vrable [Sun, 13 Mar 2011 04:32:55 +0000 (20:32 -0800)]
Try to improve support for no-aggregation mode
Make it at least a bit more performance-competitive by fetching objects
when prefetching is requested.
Michael Vrable [Sat, 12 Mar 2011 08:47:36 +0000 (00:47 -0800)]
SPEC benchmark setup using no range requests
Also a few graph updates.
Michael Vrable [Sat, 12 Mar 2011 02:39:56 +0000 (18:39 -0800)]
Results from a SPECsfs run with 8GB of memory
Michael Vrable [Fri, 11 Mar 2011 22:31:26 +0000 (14:31 -0800)]
Optimize overwrites of the last block of a file
Michael Vrable [Fri, 11 Mar 2011 20:11:58 +0000 (12:11 -0800)]
Drop another debugging message in non-verbose mode
Michael Vrable [Fri, 11 Mar 2011 19:42:14 +0000 (11:42 -0800)]
Really use the US-West region for the SPECsfs benchmark
Michael Vrable [Fri, 11 Mar 2011 19:34:04 +0000 (11:34 -0800)]
Update to a warning message to provide more debugging info
Michael Vrable [Fri, 11 Mar 2011 19:29:59 +0000 (11:29 -0800)]
Updates to scripts for a mixedbench microbenchmarking run
Michael Vrable [Fri, 11 Mar 2011 09:33:43 +0000 (01:33 -0800)]
Check in some old data regarding S3 performance
These experiments ought to be re-run, but use the old data as a placeholder
for now.
Michael Vrable [Fri, 11 Mar 2011 05:12:29 +0000 (21:12 -0800)]
Server rename for benchmarks
Michael Vrable [Fri, 11 Mar 2011 04:58:10 +0000 (20:58 -0800)]
Tweaks to code that handles read-modify-write on data blocks
Michael Vrable [Fri, 11 Mar 2011 04:23:47 +0000 (20:23 -0800)]
Prepare for microbench re-run with latest code
Michael Vrable [Fri, 11 Mar 2011 01:58:23 +0000 (17:58 -0800)]
Reduce verbosity
Michael Vrable [Fri, 11 Mar 2011 00:40:58 +0000 (16:40 -0800)]
Add a script to parse the S3 and NFS traffic statistics from a run
Michael Vrable [Fri, 11 Mar 2011 00:40:44 +0000 (16:40 -0800)]
Updates to automatic SPECsfs-launching script
Michael Vrable [Thu, 10 Mar 2011 23:25:34 +0000 (15:25 -0800)]
Reorganize benchmark scripts to support running SPECsfs as well
Michael Vrable [Thu, 10 Mar 2011 22:52:44 +0000 (14:52 -0800)]
Some configuration files for possible Postmark benchmark runs
Michael Vrable [Thu, 10 Mar 2011 22:42:19 +0000 (14:42 -0800)]
Script update
Michael Vrable [Thu, 10 Mar 2011 22:38:44 +0000 (14:38 -0800)]
Update some benchmark-running scripts
Michael Vrable [Thu, 10 Mar 2011 19:36:44 +0000 (11:36 -0800)]
Add runtime options to disable some of the log-structured optimizations
Michael Vrable [Thu, 10 Mar 2011 19:17:33 +0000 (11:17 -0800)]
Add a debug option to dump statistics counters every ten seconds
Data is appended to a file, so that it can be analyzed later. Timestamps
are incldued to align results with benchmarks.
Michael Vrable [Thu, 10 Mar 2011 18:45:41 +0000 (10:45 -0800)]
Parse and reorganize some microbenchmark results
Michael Vrable [Thu, 10 Mar 2011 06:15:41 +0000 (22:15 -0800)]
Track inter-request delay in TCP analysis
When analyzing TCP connections, track the time the connection goes idle
(between the end of one request and start of the next).
root [Thu, 10 Mar 2011 01:10:40 +0000 (17:10 -0800)]
Disable profiling collection entirely when no data is requested
Michael Vrable [Thu, 10 Mar 2011 00:48:28 +0000 (16:48 -0800)]
Note down more kernel compile benchmark results
root [Wed, 9 Mar 2011 06:12:21 +0000 (22:12 -0800)]
Tweak inode prefetching
Michael Vrable [Wed, 9 Mar 2011 04:57:15 +0000 (20:57 -0800)]
Rework inode prefetching.
Attempt to coalesce range requests for inodes where possible.
Michael Vrable [Wed, 9 Mar 2011 04:41:06 +0000 (20:41 -0800)]
Start keeping notes on tarball unpack, checksum, kernel compile, etc.
Michael Vrable [Tue, 8 Mar 2011 23:35:31 +0000 (15:35 -0800)]
Postmark results summary
Michael Vrable [Tue, 8 Mar 2011 23:34:22 +0000 (15:34 -0800)]
Minor benchmark additions/changes
Michael Vrable [Tue, 8 Mar 2011 23:28:49 +0000 (15:28 -0800)]
Infrastructure to generate PDF figures for the paper
Michael Vrable [Tue, 8 Mar 2011 20:40:46 +0000 (12:40 -0800)]
Commit SPECsfs results for an NFS server running in EC2
Michael Vrable [Mon, 7 Mar 2011 18:28:08 +0000 (10:28 -0800)]
Re-run some results with newer BlueSky code
Michael Vrable [Mon, 7 Mar 2011 00:22:30 +0000 (16:22 -0800)]
Optimize complete overwrites of file system blocks
Do not fetch the old data in this case, since it doesn't matter what it
was.
Michael Vrable [Sun, 6 Mar 2011 23:31:03 +0000 (15:31 -0800)]
Check in some more benchmark results for BlueSky/S3-west
Michael Vrable [Sun, 6 Mar 2011 23:29:07 +0000 (15:29 -0800)]
Update a results README file
Michael Vrable [Sun, 6 Mar 2011 23:27:51 +0000 (15:27 -0800)]
Script for parsing sfsres files to extract more detailed latency values
Michael Vrable [Sun, 6 Mar 2011 04:52:49 +0000 (20:52 -0800)]
Benchmark results without range requests.
root [Fri, 4 Mar 2011 22:20:25 +0000 (14:20 -0800)]
Reduce verbosity of debugging of disk cache contents
root [Fri, 4 Mar 2011 22:19:30 +0000 (14:19 -0800)]
Use virtual hosts for specifying S3 buckets
This is needed to get requests directed to the right place when using
different locations (US-West vs. US-California, for example).
Michael Vrable [Fri, 4 Mar 2011 01:36:48 +0000 (17:36 -0800)]
Add more benchmark results
Michael Vrable [Fri, 4 Mar 2011 00:10:11 +0000 (16:10 -0800)]
More memory usage stats
Michael Vrable [Fri, 4 Mar 2011 00:07:42 +0000 (16:07 -0800)]
Measure effect of read latencies vs. connection idleness
Michael Vrable [Thu, 3 Mar 2011 21:17:37 +0000 (13:17 -0800)]
Add more memory overhead data
Michael Vrable [Thu, 3 Mar 2011 21:15:39 +0000 (13:15 -0800)]
Update memory usage plot script