IBM CEO Arvind Krishna announced today that the company would no longer sell facial recognition services, calling for a “national dialogue” on whether it should be used at all. He also voiced support for a new bill aiming to reduce police violence and increase accountability.
In a letter reported by CNBC, written in support of the Justice in Policing Act introduced today, Krishna explains the company’s exit from the controversial business of facial identification as a service.
IBM firmly opposes and will not condone uses of any technology, including facial recognition technology offered by other vendors, for mass surveillance, racial profiling, violations of basic human rights and freedoms, or any purpose which is not consistent with our values and Principles of Trust and Transparency. We believe now is the time to begin a national dialogue on whether and how facial recognition technology should be employed by domestic law enforcement agencies.
This careful approach to developing and deploying the technology is not a new one: IBM last year emphasized it with a new database of face data that was more diverse than anything available at the time. After all, like any program, these systems are only as good as the information you feed into them.
However, facial recognition does not seem to have been making the company much money, if any. To be fair the technology is really in its infancy and there are few applications where an enterprise vendor like IBM makes sense. Amazon’s controversial Rekognition service, while it has been tested by quite a few law enforcement entities, is not well thought of in the field. It would not benefit IBM much to attempt to compete with a product that is similarly just barely good enough to use.
Krishna’s letter also says that “vendors and users of Al systems have a shared responsibility to ensure that Al is tested for bias, particularly when used in law enforcement, and that such bias testing is audited and reported.” This is something of a parting shot to those in the field, Amazon in particular, that have been called out for the poor quality of facial recognition systems but have not ceased to market them.
It’s unclear whether or how the company will continue to perform AI research along these lines.
The bill that Krishna writes in support of has dozens of co-sponsors in the House and Senate, and addresses a wide variety of issues faced by police departments and those they police. Among other things, it expands requirements for body cameras but limits the use of facial recognition in connection with them. It would provide grants for the hardware, but only if they are used under protocols publicly developed and listed.
The ACLU, in a statement issued regarding the bill, seemed to concur with its approach: “We need to invest in technologies that can help eliminate the digital divide, not technologies that create a surveillance infrastructure that exacerbates policing abuses and structural racism.”