Participants

Experience

• I have been very interested in a related visualization of census data for 20 years. I haven't ever gotten past the exploratory stages, but this means I am highly motivated to learn how to unravel US Census Bureau datasets.

• Roughly eighteen years of industrial experience makes me anticipate and plan for unanticipated problems.

What does this thing do?

Domain, task, and dataset

Also note that there will be areas with no people (e.g. big parks, the Stanford Industrial Park, commercial districts, the Bay, etc). I have left those clear.

How will I make it?

Proposed solution

I will show maps with the hue of polygons on the map representing the number of people living in that polygon as counted by the 2000 US Census. I will provide context to the users by making the polygons translucent, leaving the underlying map data discernible.

This project does not pretend to push the frontiers of research adequately to eject a publication. This project is designed to do something cool and useful.

I am more interested in providing (and more worried about) snappy performance than I am in broad geographical coverage. There are numerous opportunities for the performance to be inadequate. Determining the right data to display for a given clipping region, retrieving the information, aggregating information (when zoomed out), rendering the PNG image, and serving the image all take time (in addition to the time Google takes, which I won't be able to control).

I expect that I will need to trade disk space for speed, pre-processing information and caching some information on disk. As my last name isn't Google, I expect that I will not have enough disk space to handle all of the United States. I am willing to restrict the geographic range in order to ensure optimal performance. If I need to restrict the area of interest, my final paper will discuss what resources would be needed for the entire US.

Milestones

• 4 November: Proposal finished
• 13 November: One PNG file generated with one polygon extracted from dataset, requiring:
  • extracting polygons with the Shapefile C library
  • extracting the appropriate demographic data from the dataset with the Shapefile C library and the data files
  • associating polygon <->demographic data
  • understanding the gd library well enough to generate a PNG with a transparent polygon
• 20 November: Functional panning, perhaps limited to one US state and perhaps slow, requiring:
  • determining which polygons will be visible given lat/long bounds
  • iterating through visible polygons, drawing each
  • plugging overlays into the Google Maps API
• 4 December: Functional zooming
  • determining which polygons will be visible given lat/long bounds and zoom level
  • aggregating lower-level data (note that I do not think this is trivial)
• 11 December: Performance tuning and bug fixes done, possibly requiring:
  • pre-processing census bureau data into a form that is easier to extract quickly
  • prefetching of neighboring overlays
  • caching previously-used overlays
• 16 December: Status update due

Future work

• I believe that once I am able to display total population density, then it is relatively easy to extend the code to allow displaying one of many different flavors of demographic data, e.g. the non-white population. I would like to do that, think I can probably do it, but hesitate to promise it.
• Allowing the user to select information from one of several different censuses is also clearly within the realm of imagination. I believe that this is slightly too ambitious (in part due to disk space limitations) for the scope of the class.