Privacy, Data, and Performance

In a fascinating legal decision that may have repercussions for how government employs large databases to measure performance, a New York state court ruled that “the New York City Education Department must include teachers’ names in the performance-data reports it provides to news outlets to fulfill open-records requests.

Will this decision have a chilling effect on the publication of government data about agency performance?  Or will employment in the government simply come to mean that one’s work records are increasingly open to public scrutiny?

Data Quality Campaign: Cool Maps on Ed Data Systems

The DQC is, in their words, “a national, collaborative effort to encourage and support state policymakers to improve the availability and use of high-quality education data to improve student achievement.”

You can check out (on their homepage) the maps they use to chart state progress on their “10 Essential Elements” and “10 State Actions” for data quality improvement.  I’m intrigued, personally, by the relative strength of the Southern states.

Texas Two-Step: A Pair of Trends that Undermine the Textbook Influence of the Lonestar State (Pt. II)

A friend forwarded me an article about the Texas textbook market that validates some of the observations/predictions I made in March.  Specifically, it highlights trends that could be undermining Texas’ influence on the textbook market (while also questioning the validity of the theory to begin with).

Namely:

1) Texas’ actions re: curricular content could be giving rise to opposition in other states.

“The debates in Texas only heighten the sensitivity” in states and districts elsewhere to review those materials more closely before signing off, Mr. Diskey [executive director of the school division of the Association of American Publishers] added.

2) Texas is participating in breaking up its own influence by responding to incentives to provide for digital instructional materials.

In any case, amid concerns about the high cost of printed textbooks and the rapidity with which they become outdated, the Texas market for instructional materials is poised for a potential sea change. The recent legislation is expected to provide districts with new sources of digital textbooks and other electronic classroom materials.

“Now we have all of these new ways of acquiring instructional materials in addition to the traditional process,” said Anita G. Givens, an associate commissioner at the Texas Education Agency.

For instance, the state education commissioner was given authority to approve a list of digital textbooks that districts may buy with state textbook aid, providing them with new options beyond the materials adopted by the state board. Also, districts for the first time will be able to use a portion of that aid to pay for hardware, such as laptop computers, to access digital content.

“That is a big shift,” Ms. Givens said, “because one of the cost drivers in terms of whether electronic [material] makes sense is whether [schools] have the infrastructure and the access points.”

A friend today summed up the new economy: “It’s about information and networks.”  Changes in how instructional content is delivered remain one of the best symbols of this evolution.

Usability and Usefulness: Teachers and the Data They Love

I promised I’d return to the question of usefulness and usability in Instructional Improvement Systems, as it relates to the Wireless Generation report I discussed in an earlier post. Here are their conclusions, interspersed with my comments:

“First, data must be fresh: between a day and a week old . . . One large district discovered, soon after the launch of its teacher-facing system, that teachers started to call the help desk to complain as soon as the data are even three days stale.

This teacher behavior happily dovetails with research (discussed previously) that shows that short-term data analysis is most convincingly correlated with improved instruction.

“Second, data must be rich, providing multiple sources so that educators can ‘triangulate’—home in on a particular problem with the confidence that different measures agree. Many standardized assessments (including those sold as ‘formative’) are tuned for the middle of the curve, not for below-proficient students; they may be able to pick out at-risk students but do a poor job diagnosing what is causing at-riskness.

Third, data must be fine-grained enough to be instructionally actionable . . . for instance, if standards do not differentiate two-digit multiplication items that are cast as computation versus word problems, teachers may not uncover the students who need extra support in approaching word problems.

The two points above outline the classic problem of moving from a data system that provides general descriptive information (about the whole dataset) to one that provides actionable information about particular challenges.

“Fourth, if users are truly to explore data, access tools must be Google-fast and Apple-simple, with response times of, at most, a few seconds.

Who can argue?

“Finally, data needs to be clean and accurate. Happily, the best way to establish accurate education data for a student is to show it to that student’s teacher—or, of course, the student—and provide him or her with a way to address errors, for instance, by calling a help line or clicking a ‘report a problem’ link.”

Understanding variations in user behavior is an often-neglected aspect of information systems design and is a defining pursuit, as I see it, of the field of knowledge management. Concrete, human, details, such as these, increase my confidence in the expertise of the analyst.

So far, so good.

Next time we take on this issue, we’ll look at some of the peculiar dynamics that arise when initiating systems change in a non-competitive environment, such as characterizes good chunks of the human services world.

A Systems-Based Look at How Your Child Is Being Evaluated

The question of when to aggregate, and when to distribute, innovative energy in the development of data systems is an omnipresent one.  I’ve discussed before how user-friendliness, especially important in the human services field, depends upon the robustness of the underlying information system.  A recent Wireless Generation (an organization covered in an earlier post) report (a) discussed the history of information system development in state school systems and (b) provides suggestions about how to make such systems accessible, engaging, and useful.

Today we’ll cover (a), the history and will spin out some of its implications for the strategic aspects of data systems development (We’ll take on (b), usability and usefulness, at a later time.). Continue reading

From Apple to Apps: An Early Innovator’s Perspective on the Future of Personal Health Records

Few people fall in love with health information systems because of someone bombing battleships, but Peter Groen is an exception.  In 1981, while working as a computer systems analyst at a hospital in Atlanta, he was part of a team that helped a paralyzed patient to communicate by carefully attaching an electrical lead to the man’s eyelid by which he was thence able to instruct the computer to “bomb” targets in an early Apple video game. “We knew that a thinking man was trapped inside that body when he was able to follow instructions and successfully play the game.  We were then able to write a simple program that let the patient ‘write’ a simple message using a similar method of controlling the computer.”  Groen was hooked: “I couldn’t see working in finance, marketing or sales after that.  I wanted to use my knowledge to help people and working in health care was the right place to do that.” Continue reading

Texas Texts and E-Media: The True Story of How the Texas BoE May Revise Education History

You may have read about the recent textbook revisions proposed in Texas (I include both a link to The Economist‘s take and a link to the detail-full, though more partisan take of The Huffington Post.).  While The Economist, The New York Times, and others highlight the economic weight of textbook-related decisions by the State of Texas, I would argue that a more dramatic outcome may eventually involve the relative dimunition of Texas’ influence.  Namely: Texas’ potential decision creates a perfect storm to increase interest in electronic and/or open source textbooks, which do not require economies of scale as large as does the current publishing regime.

Electronic innovators and open source writers tend to be (much more often than not) precisely the sort of folks who would most object to the Texas Board of Education recommendations.  I would not be surprised to see an “alternative textbooks movement” take root in the short-term (and a less-covered Texas controversy took place on this front in recent months); I would, however, be quite surprised if such a movement does not materialize in the mid-term.