Project Name:
Building Capacity for State, Local, and Territorial Governments to Use Administrative Data for Evidence-Building
Contractor: BrightQuery, Inc.
Lessons Learned
- AI Backend Setup: The process of setting up the AI backend and website was a learning experience that will help streamline future developments.
- State Collaboration: Early engagement with state partners is critical to ensure project milestones are met on schedule.
- Data Sharing Agreements: We leveraged existing Data Sharing agreements wherever possible. Some states like CA have data linked up end to end and ready to be used while others have an MoU in place between different participating agencies where data needs to be linked and extracted on specific uses like in the case of CT. Both arrangements have their own pros and cons and are useful in different states of maturity of insight generation. The final long-term objective should be to generate insights at the state level which can then be aggregated at the federal level for a concerted policy making and evidence building.
- AI Backend Setup: The process of setting up the AI backend and website was a learning experience that will help streamline future developments.
- Platform Development: The development of the UI and data exploration tools provides valuable experience for future iterations of the platform.
- Data Sharing Concerns: Data sharing concerns between agencies are legitimate and based on legal and privacy considerations. These cannot be solved simply through effort; new techniques will be required in combination with political and administrative considerations.
- Data Silos: Data siloed within individual states will always have a “visibility horizon” at the state’s borders.
- State Size: Larger states have an inherent advantage in collecting and linking data. Smaller states have a higher proportion of their population leaving and entering the state.
- Workforce Churn: People drop out and re-enter the workforce in different states due to multiple reasons like the workforce/skills being seasonal, people taking a break from working and re-entering the workforce, people taking retirement etc. Eg: moose hunting or fishing which is possible in summer only, some people in financial services did not seek jobs for a few quarters after the 2008 stock market crash. In these cases, linking at a statistical level is the only alternative.
Disclaimer: America’s DataHub Consortium (ADC), a public-private partnership, implements research opportunities that support the strategic objectives of the National Center for Science and Engineering Statistics (NCSES) within the U.S. National Science Foundation (NSF). These results document research funded through ADC and is being shared to inform interested parties of ongoing activities and to encourage further discussion. Any opinions, findings, conclusions, or recommendations expressed above do not necessarily reflect the views of NCSES or NSF. Please send questions to ncsesweb@nsf.gov.
