Infrastructure

Retrieving a system metadata document takes 1-2 seconds in the production environment. Response time is improved on subsequent calls, but still takes longer than a second to complete. Since system metadata is critical for many operations, its retrieval should not be an impediment to users. At this rate, a simple single threaded client may download information about 30 or so objects per minute, or about 1800 per hour. Since some data packages have content in the order hundreds to thousands of entries, this means that it would take an hour or so to simply iterate over the system metadata for a moderate data package.

The retrieval process should be profiled to identify which portions are inefficient, then those portions addressed where possible.