Editor's Note

The FOI Advocate is a compendium of ideas, edited story excerpts and other materials from a variety of Web sites, as well as original concepts and analysis. When the information comes directly from another source, it will be attributed and a link will be provided whenever possible. The blog relies on the accuracy and integrity of the original sources cited. We will correct errors and inaccuracies when we become aware of them.
Showing posts with label databases. Show all posts
Showing posts with label databases. Show all posts

Friday, August 21, 2009

Idaho organization launches salary database

The Idaho Freedom Foundation created a database on OurIdaho.com in which people can search for the names and salaries of government employees, KTVB.com reported. The IFF obtained the data via FOIA requests, and its database contains nearly 40,000 employees.
Want to know how much money your child's teacher makes? How about the police officer who pulled you over last night?

Now you can.

A group that bills itself as a think tank dedicated to limited government has launched a salary database, that allows anyone to look up the names and pay rates for a range of government employees.
More here.

Friday, June 26, 2009

U.S. Government CIO speaks about plans for Data.gov

Wired published a Q&A with Vivek Kundra, the U.S. government's first-ever chief information officer, in this month's issue. Kundra spoke about his plans for Data.gov and navigating privacy issues. Wired also has its own Wiki where people can report government data that is not accessible and can suggest how accessibility to government data could be improved.

The Obama administration's most radical idea may also be its geekiest: Make nearly every hidden government spreadsheet and buried statistic available online, all in one place. For anyone to see. Are you searching for a Food and Drug Administration report that used to be obtainable only through the Freedom of Information Act? Just a mouseclick away. Need National Institutes of Health studies and school testing scores? Click. Census data, nonclassified Defense Department specs, obscure Securities and Exchange Commission files, prison statistics? Click click. Click. Click.

The man in charge is the US government's first-ever chief information officer, Vivek Kundra. Previously CTO of the District of Columbia, Kundra, 34, knows that the move from airtight opacity to radical transparency won't be a cakewalk. Until now, the US government's default position has been: If you can't keep data secret, at least hide it on one of 24,000 federal Web sites, preferably in an incompatible or obsolete format.

More here.

Saturday, June 20, 2009

Groups win access to Calif. lawmakers database

The California First Amendment Coalition and MAPLight.org won access to a machine-readable state lawmakers database in its settlement with the Office of Legislative Counsel of California, the California Chronicle reported. The previous form of the database hindered analysis. After the lawsuit was filed, the Office of Legislative Counsel unrolled a "structured database" on its Web site, which can be downloaded by anyone at www.leginfo.ca.gov. MAPLight.org plans to use the structured database to create MAPLight.org California, which will "combine all money given to members of the California state legislature with how each politician votes on every bill, revealing patterns of money and influence never before possible to see."
The California First Amendment Coalition (CFAC) and MAPLight.org, a nonpartisan, nonprofit research organization that shows the connection between money and politics, announce today that they have settled their freedom of information lawsuit against the Office of Legislative Counsel of California, having gained the object of their suit: a machine-readable database of how state lawmakers vote.

"It shouldn't take a lawsuit for the government to realize its data belongs to the people," said Daniel Newman, MAPLight.org's executive director. "In this new era of highlighting transparency, we hope this settlement serves as an example to city and state governments across the country to provide public access to public information."

California Legislative data, including how lawmakers vote, legislation in progress, and laws, was previously available to the public only in a plain-text format on the California Legislative Information website. That data was suitable for viewing and printing, but only allowed access to Legislative data at a rate of one bill at a time, making analysis lengthy and cumbersome.
More here.

Saturday, June 06, 2009

NFOIC Summit: Infrastructure coverage tips


James Shiffer, reporter and editor at the Minneapolis Star Tribune; Tisha Thompson, investigative reporter at WTTG Fox 5 in Washington, D.C.; and Jaimi Dowdell, IRE training director and former computer-assisted reporting editor at St. Louis Post-Dispatch, discussed how to use FOI to inform the public about infrastructure issues. Patrice McDermott, director of OpenTheGovernment.org, moderated. Here's part two of the notes from their session at the 2009 NFOIC Summit:

Tips for infrastructure coverage:
  • Look at the annual report card put out by the American Society for Civil Engineers each year.
  • Keep the National Bridge Inventory and National Inventory of Dams database handy.
  • Use electronic databases to lead you to paper documents.
  • When looking at infrastructure records, contact state inspectors and civil engineers. They can help you analyze data so you don't make mistakes. If possible, first contact other reporters who have done similar stories in other cities.
  • The smaller the town or jurisdiction, the better chance you'll have of getting data. Bigger cities become savvier.
  • Ask for five years of inspection reports to notice problems that haven't been fixed.
  • Start with bridges and dams stories. River communities should look into levees.
  • Keep a list of those you request records from. Divide them into a naughty and nice list. Send Christmas cards to both. Be creative.
  • Go to your local transportation department and goggle what it has posted.
  • Look at the infrastructure in urban sprawl areas.
  • For a breaking news story, immediately go to the web and take screen shots of everything you can find about the bridge, dam, etc. Chances are that someone will take that info down.
  • When googling something, click on the Google cached link, which Tisha Thompson refers to as the "sexiest thing in the world." It shows you what a Web page looked like on a certain day.
  • You can also use Wayback Machine to find older versions of Web pages. Thompson used this to access the Web site of Eliot Spitzer's call girl after her site was removed. She was able to obtain information about her and her picture. Warning: This site doesn't delve deeply into federal and state government Web sites.
  • Use your stories to highlight the ridiculous excuses given for why information isn't made public.
  • Find the human element. Remind agencies that people have a right to this information. This is the people's money and safety at stake.
  • Find an inspector who cares and convince him/her to provide you with data or the records.
  • Get data any way you can, even if it's in a PDF file. Then, find someone who can figure out how to turn it into something usable.
  • Trick from Jaimi Dowdell: If a government agency says it can't export data because of the system it's using, just say "Well, that's terrible. But I have to give my editor a report back on why I couldn't get this data. What's the name of your software?" Then call that software company and tell them that their client says it can't export the data. Chances are, the software company will say its software can do back flips. It usually contacts the clients and essentially helps you get the data.
  • Conduct advanced searches in Google and search by file type.
  • Fish for data and know what's out there. Agencies can't claim records don't exist that way.
  • Consider looking into highway construction as well as asphalt and concrete contracts.
  • Look into data on electricity grids, fire hydrants, street light outages, pot holes, population growth, water main breaks, road construction, etc. Who's getting stimulus funding?
  • Request videos and photos in your FOI requests.
  • Find more tips here.

Friday, June 05, 2009

NFOIC Summit: Minnesota FOIA roundup


State-by-state updates at the 2009 NFOIC Summit: Helen Burke of the Minnesota Coalition on Government Information provided a summary of her state's FOI news.
  • The governor's approach toward retention of e-mails is that they be kept up to 90 days, preferably 30 days.
  • Minnesota took a step in the right direction with the Transparency and Accountability Project which includes vendor reports.
  • Minnesota doesn't allow cameras in the courtroom, but the Supreme Court has said there can be a commission set up to explore this issue. It's moving at a glacial pace but in a good direction.
  • The Uptake streamed the hearings regarding the Franken/Coleman senatorial election.
  • Public access suffered a setback when the governor signed into law a bill that defines the Department of Natural Resources database as not a public database.

Thursday, May 28, 2009

City slowly releases payroll records

The San Jose Mercury News filed a public records request for the 2008 payroll records for all city workers in order to create public employee compensation databases. All jurisdictions provided the full records except for Watsonville, which is releasing information "as it becomes available." Watsonville initially just released records on the highest paid police officers and firefighters. It hurried to released the names and salaries of other employees who made more than $100,000 because some thought police and firefighters were being targeted. The city attorney says Watsonville is only legally bound to release records for employees with salaries of $100,000 or more.

City officials have released the names and salaries of 27 employees who made more than $100,000 in 2008.

The release came late Friday, a day after the Sentinel published the names of police and firefighters who earned more than $100,000 in 2008, a story that sparked controversy in City Hall corridors and in the community.

On April 27, the Sentinel made a public records request for the 2008 pay records for all city workers as part of a countywide project to create public employee compensation databases. The city and county of Santa Cruz databases are available on the Sentinel's Web site, santacruzsentinel.com.

More here.

Wednesday, April 08, 2009

Aircraft collisons involving birds increase 62 percent

An average of 524 aircraft collisions per year are caused by geese and other large birds, UPI reported. U.S. Federal Aviation Administration data indicate that these collisions have risen sharply. The FAA had proposed to bar the release of this data, so as not to discourage airports from reporting incidents. However, a spokesperson said FOIA requests are not being denied.
Serious collisions between large birds and airliners have risen sharply this decade, a U.S. Federal Aviation Administration report shows.

Richard Dolbeer, a retired U.S. Department of Agriculture wildlife biologist who created the FAA database on bird-plane collisions in 1990, says growing populations of large birds are a factor, USA Today reported Tuesday.

"In most cases it's going to be these large birds that are going to cause a catastrophe or a significant strike event," Dolbeer said.

More here.

Saturday, March 14, 2009

Colbert Report addresses gun-permit privacy war

Stephen Colbert says he "longs for a day when gun owners no longer have to hide their relationship with their concealed weapons." This five-minute video features Colbert's thoughts on the Memphis Commercial Appeal's decision to post a handgun-carry permit database online.

More here.

Monday, March 09, 2009

Congressional data mining could be on its way

A provision that would Congress and its bodies to release data in raw form was slipped into a spending bill passed by the House of Representatives, Mother Jones reported. If the Senate doesn't edit out the three-sentence statement, the public will no longer have to rely on government Web sites, which filter the data they provide. Some Web sites already use remix raw data to create databases and charts, but they must "scrape" government sites to obtain this data -- a process that is cumbersome and not perfect.

By slipping a simple, three-sentence provision into the gargantuan spending bill passed by the House of Representatives last week, a congressman from Silicon Valley is trying to nudge Congress into the 21st Century. Rep. Mike Honda (D-Calif.) placed a measure in the bill directing Congress and its affiliated organs—including the Library of Congress and the Government Printing Office—to make its data available to the public in raw form. This will enable members of the public and watchdog groups to craft websites and databases showcasing government data that are more user-friendly than the government's own.

If the Senate passes the bill with the provision intact, citizens seeking information about Congress' activities—such as bill names and numbers, amendments, votes, and committee reports—won't have to rely on government websites, which often filter information, are incomplete, or are difficult to use. Instead, the underlying data will be available to anyone who wants to build a superior site or tool to sift through it. "The language is groundbreaking in that it supports providing unfiltered legislative information to the public," says Honda's online communications director, Rob Pierson. "Instead of silo-ing the information, and only allowing access through a limited web form, access to the raw data will make it easier for people to learn what their government is doing."

More here.

Tuesday, February 24, 2009

Debate over release of gun permit databases fires up in Tenn.

For $80.50, the Tennessee Department of Safety will release the name, date of birth, address and permit issue and expiration dates for all gun permit holders. However, obtaining that information may soon be impossible, and printing it may result in a $2,500 fine, the AP reported. A bill to make gun permit databases confidential and publication of them punishable by fines will go before the House Criminal Practice Subcommittee on Wednesday.
Tennessee lawmakers are ready again to try to muzzle state records that list who has a permit to carry a concealed handgun, and this time they are considering making it a crime to publish information about gun ownership.

The measure sponsored by Rep. Eddie Bass, a Democrat from Prospect, would make information on gun permit holders confidential and exempt from the state's open records law. The bill is scheduled for a hearing Wednesday by the House Criminal Practice Subcommittee.

For 12 years, similar legislation has failed to make it to a floor vote, but this year's version has a new twist and a better chance of passage now that Democrats who previously blocked the bill, including former Speaker Jimmy Naifeh, no longer control the House.

More here.

Saturday, February 14, 2009

Poynter: Journalists should give reasons for publishing gun permit lists

Al Tompkins of the Poynter Institute wrote in his daily column that journalists should not publish databases, such as gun permit databases, just because they are public records. Journalists should explain why they are publishing it, he said. Gun supporters have argued against the publication of these records for years, and Tennessee is considering making such publication a felony.
The Tennessee legislature is considering legislation that would make it a felony to publish the state's concealed carry gun permits [PDF].

For the last 10 years, gun backers in that state have bragged that permitted gun carriers aren't ever charged with gun crimes. That changed this week when a Memphis area man who had a permit and a gun shot another guy and was charged with second degree-murder.

The Commercial Appeal in Memphis proceeded to post the state's concealed carry permit list, and now gun backers are pitching a fit.
More here.

Friday, February 06, 2009

Should gun-carry permit applications be public?

Many permit owners are uncomfortable knowing that their addresses, gun purchases and other personal information, such as past addictions, are public records. On the other hand, public gun permit databases could help keep firearms out of the hands of criminals. John Harris, executive director of the Tennessee Firearms Association, said the House committees that deal with Second Amendment issues favor privacy.
What some are calling a matter of privacy, others are calling a dangerous idea. At issue is whether or not applications for gun-carry permits should be kept confidential.

Getting a permit isn't only about learning the rules; a lot of personal information must be given up.

"You have to answer a lot of questions," said John Harris, executive director of the Tennessee Firearms Association. "Like, for example, 'How were you discharged from the military?' 'Have you ever been addicted to any kind of alcohol or other substances?' 'Have you ever had any psychiatric problems?' A lot of information is disclosed on the forms that really shouldn't be public."
More here.

Wednesday, September 24, 2008

Complete details on salvaged cars coming in early 2009

Determining if the vehicle you're about to purchase has been in an accident or flood isn't easy. There is no consistent nationwide reporting system, which has led to numerous cases of fraud.

According to the LA Times, the implementation of the National Motor Vehicle Title Information System will require state motor vehicle administrators, insurers and junkyards to report title information to a central database.

Sixteen years ago, Congress passed a law requiring the creation of a national database of vehicle title information that would allow consumers to determine whether a vehicle had been in a serious accident. It seemed like a great idea, but it was never implemented.

Thanks to a federal court ruling today, however, that should soon be changing.

A U.S. District Court judge for the Northern District of California handed down a decision that requires the federal government to create a database of stolen cars and state, insurance and junkyard title information. Government-supplied data are to be made public by the end of January, with private industry data coming out by the end of March.

The ruling comes after years of pressure from consumer groups, which pointed out that without access to such information, motorists cannot really know whether a vehicle has been severely damaged or "totaled." That's a serious safety risk, because badly wrecked cars can be unsafe to drive even if they're repaired.

More here.

Tuesday, September 16, 2008

Use of city's take-home cars remains secret

The Journal-News requested data on the use of take-home cars provided to Yonkers, N.Y., municipal employees. But city officials say the data is not public record and would be too difficult and time-consuming to extract.

City Hall officials maintain that the city keeps no records that they are required to show the public on how take-home vehicles issued by the city to 194 municipal employees are used.

The Journal News requested records of the amount of gasoline used and the miles driven by employees with the city-owned vehicles dating to 2003. The newspaper made the request under the state's Freedom of Information Law.

"Please be advised that no individualized records exist," wrote city Records Access Officer Eric Arena last month, responding to a May 9 request for information.

More here.

Wednesday, September 03, 2008

New York increases charges for electronic public records

Time is money. New York's change in its Freedom of Information Law will increase the bill of those requesting electronic public records by charging for an employee's time spent filling the requests.

New Yorkers might get an unpleasant surprise when they ask their government for databases and other types of electronic public records.

Last month, New York quietly changed its Freedom of Information Law to allow government agencies to charge for an employee's time when they fill citizens' requests for electronic records, provided they need to spend more than two hours filling the request.

The agency must supply an estimate of the cost beforehand in order to be able to collect, said Robert J. Freeman, executive director of the state's Committee on Open Government. The change, which Gov. David Paterson signed into law in August, benefits governments but could discourage citizens from asking for government records, Freeman said.

More here.

Thursday, July 31, 2008

Information Games: How Many Animals Killed?

Jeff Barnard, who covers environmental issues for the Associated Press, weighs in with this fascinating tale of information control...shall we say selective presentation? Perhaps the national picture is less flattering than your individual state...do you want to go back and request the national tabular data?


Until now, anyone who wanted to know how many wolves, skunks or even robins that hunters for the U.S. Department of Agriculture shot, poisoned or snared across the nation could look it up on an agency Web site.

The department's Wildlife Services agency, whose job is "creating a balance that allows people and wildlife to coexist peacefully," spent $117 million in fiscal year 2007 to kill 2.4 million wild animals representing 319 species, up significantly from the year before.

But the latest report obscured the nationwide numbers.

The report on fiscal year 2007 posted on the agency's Web site last week requires anyone interested in nationwide totals to call up individual reports from each of the 50 states and then do the math.

The new color pie charts and drop-down menus of state-by-state listings came on the heels of the agency's refusal even to post the information for fiscal 2005 and 2006 until after conservation groups sent a formal demand letter reminding Deputy Director William Clay of a 2000 federal court ruling requiring the agency to do so under the Freedom of Information Act, said Wendy Keefover-Ring of WildEarth Guardians. The group does an annual analysis of the numbers as part of a campaign to cut federal funding for killing predators.

More here.

Tuesday, July 01, 2008

A Rather Interesting FOI Data Request...

A Cook County judge ruled Monday that the Chicago Police Department does not have to turn over the underlying data from a controversial study on eyewitness identification methods that critics and academics have called junk social science.

Defense lawyers led by a group from Northwestern University Law School's Roderick MacArthur Justice Center sued the city and the Police Department to get the data from a 2006 study led by a Police Department lawyer.

The study purported to show that the traditional method of police lineups in which witnesses see all the subjects at once was more accurate than a method in which witnesses are shown subjects one at a time by an officer who does not know the identity of the suspect.

Although academics have dismissed the Chicago study as unscientific, several law enforcement agencies across the country have held it up as a bulwark against changing their own lineup procedures, said Scott Ehlers of the National Association of Criminal Defense Lawyers, a lobbying group that filed the suit.

Tuesday, December 04, 2007

Great work from a smaller market...

For all of those out there who think building FOI-driven databases is too hard and too expensive and too time-consuming, take a look at the Bristol, Virginia, Herald Courier's newest online venture...

Gathering local government salaries from across Southwest Virginia and Northeast Tennessee was not only an arduous exercise of fiscal oversight for this newspaper, but also showed that localities routinely fail to follow open records laws.

The Bristol Herald Courier set out more than a year ago to collect salary data from what ended up being 65 local jurisdictions funded by taxpayers.

Every town, city, county and school system in an 11-county, two-state region – an area with a collective land mass larger than the entire state of Connecticut – was compiled for comparison purposes.

But not without a futile fight from many jurisdictions.
Johnson City never fully complied with our request under the Tennessee Public Records Act; instead of releasing first names, as the law requires, Johnson City disclosed first initials.

It also took Johnson City more than four months to even release the salaries of its city employees.

“Tennessee law says records in the hands of government shall be open for inspection during business hours and cannot be withheld unless there is a specific law that makes it confidential,” said Frank Gibson, executive director of the Tennessee Coalition for Open Government. “It’s assumed that means immediate release, but there is not a specific limit on how much time a custodian has to respond or to provide the information.”

An open government study committee has recommended that Tennessee implement a four-day time frame for compliance with the Public Records Act.

“Simple, small requests are to be immediate,” Gibson wrote in an e-mail. “In others the record keeper must grant the request or within 4 days cite a specific exemption in the law that allows the information to be withheld or explain why the record can’t be produced within the 4-day period.”

As Johnson City finally released the salary records, the city also tried to engage in a bit of horse trading.

See the whole series -- and access the database -- here.