I did implement that actually but ended up taking it out! A few issues.
First, the front camera FOV isn't wide enough. As soon as you start rotating the phone you lose tracking because the camera isn't pointed at your eyes any more - and besides that you're just constantly losing tracking, even using ARCore libraries.
Second, without knowing the exact lens geometry of each phone's camera, getting a true device-relative eye position is very difficult.
But the real killer is that nobody wants their wallpaper app to open the camera, ever. Shame because when it worked it was pretty cool. You could put the phone flat on a table and the view would stay correct as you moved your head.
In a few years when phones with real 3D screens come out, this won't be an issue. They'll likely have hardware eye tracking built in.
1
u/The_Dr_B0B 7d ago
Question out of curiosity, how hard would it be to have the front camera track the eye position and adjust the image accordingly?