Scientists working at the University of Bath have developed a soft and highly flexible touch screen with the potential to radically change the way people use their digital devices for shopping, banking, health and gaming.
The screen becomes softer or stiffer in direct response to the user’s touch, pictured – so before buying online, for instance, the shopper of tomorrow may be invited to ‘touch’ the fabric of a new sofa or ‘feel’ the softness of a pillow simply by pressing on their phone display.
The ‘deformable’ screen could also change the way users interact with files and apps on their devices – to delete a file they may simply push on its icon until it stiffens and eventually ‘pops’ like a bubble.
The screen, called DeformIO, is still a prototype and, according to the university, will require at least a decade of further development before it can be passed on to tech companies to be shaped into a commercial product.
However, its inventors in the university’s computer science department regard it as groundbreaking technology.
James Nash, a computer-science postgraduate at Bath and first author of a study describing the new technology, said it meant users would be able to direct manipulating a digital object the way they normally would a physical one.
He said while this was not the first iteration of a deformable display, earlier models created a less continuous experience than DeformIO.
“These relied on arrays of raised ‘pins’ lying beneath the display which, when depressed, lowered a section of screen. Such technology results in sharp breaks or steps between areas of the screen when pressure is applied,” he said.
“DeformIO, which is made of silicone, works in an entirely new way, using pneumatics and resistive sensing [a technique that transforms physical forces into electric signals] to detect pressure.”
With the technology, a user could depress the screen then run their finger across the surface to create a natural, continuous movement, he added.
“Our screen allows users to perceive rich tactile feedback on a soft surface. It gives the same benefits as today’s glass-based screens – which allow you to control your device by moving your finger fluidly across the surface – but with the added benefit of a person being able to use force to interact with their device at a deeper level.”
Another feature of the DeformIO is that it allows a user to apply forces to multiple areas on a screen simultaneously, with the display being able to distinguish between levels of pressure applied, creating degrees of softness appropriate to the force detected.
University of Bath computer scientist Prof Jason Alexander, who has been working on deformable screens for the past 10 years and is leading the research on DeformIO, said the 25cm x 25cm prototype developed in his lab had been built “to explore a vision of devices with screens that you can push through and they can push back”.
He added: “We hope that in 10 to 20 years’ time, the concepts it embodies could be in your mobile phone. For now, we’re exploring the applications it might be best suited to.”
Possible applications for DeformIO include:
Video games. During a battle sequence, for example, the display might deform as a player pushes an action button on the screen while also creating physical resistance through the screen when an opponent strikes back.
Computer simulations for medical training. For example, a medical student might detect a cyst that’s invisible to the naked eye by palpating a screen.
Car touchscreens. By replacing hard touchscreens with DeformIO, stiffness cues from the deformable screen could help drivers find buttons or slides and receive ‘physical’ information back without taking their eyes off the road.
Remote ‘physical contact’. Two people on a video call might be able to make ‘physical contact’ through their screens, where one person exerts finger pressure on their display and the person on the receiving end both sees and feels a depression on their own screen.
Digital maps. A user would be able to toggle between street view, satellite view, topographical view and more, simply by changing the pressure exerted by a finger.
According to James Nash, anyone using DeformIO to access digital maps could get an enormous amount of information.
“For instance, by pushing into a city you’d get instant demographical data and by pressing on a specific shop you’d know from its level of stiffness if it was open,” he added.
The DeformIO display was debuted this month at CHI 2024 – the ‘CHI Conference on Human Factors in Computing Systems’ – the leading international conference on Human-Computer Interaction.
The project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme.
Top image by Matt Sutton, University of Bath
