This AI Senses Humans Through Walls 👀


Dear Fellow Scholars, this is Two Minute Papers
with Károly Zsolnai-Fehér. Pose estimation is an interesting area of
research where we typically have a few images or video footage of humans, and we try to
automatically extract the pose a person was taking. In short, the input is one or more photo,
and the output is typically a skeleton of the person. So what is this good for? A lot of things. For instance, we can use these skeletons to
cheaply transfer the gestures of a human onto a virtual character, fall detection for the
elderly, analyzing the motion of athletes, and many many others. This work showcases a neural network that
measures how the wifi radio signals bounce around in the room and reflect off of the
human body, and from these murky waves, it estimates where we are. Not only that, but it also accurate enough
to tell us our pose. As you see here, as the wifi signal also traverses
in the dark, this pose estimation works really well in poor lighting conditions. That is a remarkable feat. But now, hold on to your papers, because that’s
nothing compared to what you are about to see now. Have a look here. We know that wifi signals go through walls. So perhaps, this means that…that can’t be
true, right? It tracks the pose of this human as he enters
the room, and now, as he disappears, look, the algorithm still knows where he is. That’s right! This means that it can also detect our pose
through walls! What kind of wizardry is that? Now, note that this technique doesn’t look
at the video feed we are now looking at. It is there for us for visual reference. It is also quite remarkable that the signal
being sent out is a thousand times weaker than an actual wifi signal, and it also can
detect multiple humans. This is not much of a problem with color images,
because we can clearly see everyone in an image, but the radio signals are more difficult
to read when they reflect off of multiple bodies in the scene. The whole technique work through using a teacher-student
network structure. The teacher is a standard pose estimation
neural network that looks at a color image and predicts the pose of the humans therein. So far, so good, nothing new here. However, there is a student network that looks
at the correct decisions of the teacher, but has the radio signal as an input instead. As a result, it will learn what the different
radio signal distributions mean and how they relate to human positions and poses. As the name says, the teacher shows the student
neural network the correct results, and the student learns how to produce them from radio
signals instead of images. If anyone said that they were working on this
problem ten years ago, they would have likely ended up in an asylum. Today, it’s reality. What a time to be alive! Also, if you enjoyed this episode, please
consider supporting the show at Patreon.com/twominutepapers. You can pick up really cool perks like getting
your name shown as a key supporter in the video description and more. Because of your support, we are able to create
all of these videos smooth and creamy, in 4k resolution and 60 frames per second and
with closed captions. And, we are currently saving up for a new
video editing rig to make better videos for you. We also support one-time payments through
PayPal and the usual cryptocurrencies. More details about all of these are available
in the video description, and as always. Thanks for watching and for your generous
support, and I’ll see you next time!

100 Comments

  1. Tactical Milkman said:

    lion mains be like

    October 25, 2019
    Reply
  2. Person Man Man said:

    Thanks, now SkyNet will have Wall Hacks

    October 25, 2019
    Reply
  3. cringe alot said:

    No one:
    Legit no one:
    American military in a few years:
    BITCH WE HAVE XRAY

    October 25, 2019
    Reply
  4. Michael Bay said:

    we call this wallhack in the gaming industry. It has been for decades pfss

    October 25, 2019
    Reply
  5. Insert Name said:

    Its pulse from Rainbow Six Seige isn't it

    October 25, 2019
    Reply
  6. Its jimmy said:

    But can it see through my crushes cloth?

    October 25, 2019
    Reply
  7. Fighter MKII said:

    So your telling me… someone invented wall hack?

    October 25, 2019
    Reply
  8. haku said:

    Wallhack

    October 25, 2019
    Reply
  9. TeamXhussam said:

    Why do I feel pulse's pickrate increasing..

    October 25, 2019
    Reply
  10. EvveeVeeVeeWuu said:

    Detective vision

    October 25, 2019
    Reply
  11. Papzi said:

    stöp stöp, this is not okay

    October 25, 2019
    Reply
  12. lapidations said:

    Robots will be torturing us in by 2030 won't they?

    October 25, 2019
    Reply
  13. Alireza Khosravi said:

    this is what wall hack in real life

    October 25, 2019
    Reply
  14. Dylan Yt said:

    So you can do this but yet the kinetic xbox 360 cant do anything

    October 25, 2019
    Reply
  15. Mymom247 said:

    IRL esp hacks

    October 25, 2019
    Reply
  16. Nostalgia For Infinity said:

    "Scientists were so preoccupied with whether or not they could, they didn’t stop to think if they should." – not me.

    October 25, 2019
    Reply
  17. SquiDragon said:

    That’s not fair, now robots have wall hacks too!

    October 25, 2019
    Reply
  18. Crow said:

    2:47
    Not sure it was a problem that this didn't exist

    October 25, 2019
    Reply
  19. dankito inseguro said:

    Volvo pls fix xd

    October 25, 2019
    Reply
  20. Horst Fritz said:

    Now the military wont drop bombs anymore but wifi routers, so their snipers can shoot with better sight…

    October 25, 2019
    Reply
  21. DNSXH1 said:

    Apaga el lulo.

    October 25, 2019
    Reply
  22. fermentarted gaming said:

    enemies are about to scan the area, starting timer

    October 25, 2019
    Reply
  23. maymayman said:

    This is scary

    October 25, 2019
    Reply
  24. Dominik Salceda said:

    REAL LIFE WALL HACKS

    October 25, 2019
    Reply
  25. RealJay said:

    Martyrdom
    Drop a live grenade when killed!

    October 25, 2019
    Reply
  26. Jasper said:

    Wall hacks

    October 25, 2019
    Reply
  27. Leon K said:

    The dark knight handy transmitting Computer becomes reality

    October 25, 2019
    Reply
  28. Nova X said:

    AI….

    Has turned into a difficult situation

    October 25, 2019
    Reply
  29. Andrew said:

    Nem tudtam, hogy magyar technológia.

    October 25, 2019
    Reply
  30. Justin Y. is a weeb said:

    still waiting for the AI that can see trough clothing

    October 25, 2019
    Reply
  31. Mustache Merlin said:

    Wow!! I came into this thinking it was an AI that had learned to make plausible extrapolations of pose data for occluded subjects. Nope! They legitimately taught an AI to track humans through walls with radiowaves. If you had told me that three minutes ago I would have said that was science fiction!

    October 25, 2019
    Reply
  32. Malicous steve said:

    Everyone start making their EMP devices

    October 25, 2019
    Reply
  33. LynnSx said:

    The machines can kill us between walls now, nice

    October 25, 2019
    Reply
  34. Cotton_Door42 said:

    2:03 did they use the ai to blur his face?

    October 26, 2019
    Reply
  35. Vaxile said:

    Easy wall hack.

    October 26, 2019
    Reply
  36. Womble said:

    So in the future ill be able to use skeet and tap nn's with irl cheats? Now this is epic

    October 26, 2019
    Reply
  37. Marley Lanikea said:

    Hide and go seek is about to get way easier

    October 26, 2019
    Reply
  38. Clumsy Player said:

    Wall hack on ez Vac

    October 26, 2019
    Reply
  39. Michie fuk Yu said:

    So pulse from r6 is possible

    October 26, 2019
    Reply
  40. IMPc said:

    imagine hiding behind cover and get shot directly by robots

    October 26, 2019
    Reply
  41. Adlin Ling said:

    See I told you.

    October 26, 2019
    Reply
  42. James Edition said:

    Question?

    Can someone "In theory" hack our Internet to use our WiFi and basically see everything in our room?

    October 26, 2019
    Reply
  43. Буфер said:

    real life wall hack

    October 26, 2019
    Reply
  44. Roland Knutsson said:

    Crrrreeeeeeppppyyyy

    October 26, 2019
    Reply
  45. Closed said:

    robots have already aimbot but now even wallhack imscared fuck

    October 26, 2019
    Reply
  46. Squeakers The Gryphon said:

    There goes sticky note over camera.

    October 26, 2019
    Reply
  47. Dougy Dozier said:

    So your saying…. X-RAY GOGGLES.
    I’m expecting Xbox goggles and an X-ray camera in my iPhone 12 now.

    October 26, 2019
    Reply
  48. DEVOUR my Love said:

    Muhahahaha the Hungarian empire will rise!

    October 26, 2019
    Reply
  49. Ronak Dhakan said:

    WiFi signals go through what kind of walls?

    October 26, 2019
    Reply
  50. The name of the rose said:

    Is that an italian accent?

    October 26, 2019
    Reply
  51. Joe Q said:

    Xray hacks. Oh boy warfare just got 10x more bloody.

    October 26, 2019
    Reply
  52. Get Riced said:

    Theres real wallhack now? great….

    October 26, 2019
    Reply
  53. Rand0mN0ob 132 said:

    Frickin esp

    October 26, 2019
    Reply
  54. God 4. said:

    Ah yes,now i can hack like csgo

    October 26, 2019
    Reply
  55. bruh moment said:

    I wonder what influence surrounding Wi-Fi networks have on technologies like these. Specifically, if I had a very powerful AP running in my house, could this system still function as well as it does here?

    October 27, 2019
    Reply
  56. Crafthird Qz said:

    Soon : Anti identification clothes

    October 27, 2019
    Reply
  57. SizedMouse9 said:

    Wall hacks in real life

    October 27, 2019
    Reply
  58. David Williston said:

    Humans always looking for more ways to kill eachother. Congratulations.

    October 27, 2019
    Reply
  59. Rathey said:

    alexa finna win hide and seek all the time

    October 27, 2019
    Reply
  60. Gaming with Flash said:

    Your videos are awesome(:

    October 27, 2019
    Reply
  61. Number Six6 said:

    Someone needs to monitor what is being invented on this planet. Just like wakanda, hide in the mountains then go stop those these parasites and their inventions.
    I swear, they are not from this solar system. This system needs quarantine.

    October 27, 2019
    Reply
  62. OfficialCloud9 said:

    Dd

    October 27, 2019
    Reply
  63. Random Chicken said:

    alrite it's over

    October 27, 2019
    Reply
  64. Yit said:

    Imagine seeing another skeleton when you think youre the only ones in the building

    October 27, 2019
    Reply
  65. Fuschia said:

    Walls cannot protect you anymore.

    October 27, 2019
    Reply
  66. Richi said:

    Basically a wallhack for the military.

    October 27, 2019
    Reply
  67. Manganeto ! said:

    The military is gonna love this

    October 27, 2019
    Reply
  68. V1Gibby said:

    “You can run but you can’t hide”

    October 27, 2019
    Reply
  69. Thomzd said:

    >> AI starts detecting presence in an empty room
    >>

    October 28, 2019
    Reply
  70. Dakota Teears said:

    This is just like Batman's Detective Mode!

    October 28, 2019
    Reply
  71. DoodleDoop said:

    damn they made wall hacks a real thing.

    October 28, 2019
    Reply
  72. Trench Man said:

    Now give it it a gun

    October 28, 2019
    Reply
  73. Flair said:

    Finally we've attained clairvoyance

    October 28, 2019
    Reply
  74. lostskyx said:

    The applicability of neural networks is amazing. This is almost certainly not possible with traditional coding methods. Does this mean that animals with antennas on their heads can see objects with radio waves?

    October 29, 2019
    Reply
  75. DEEPAK JOSEPH said:

    Hmmmmm…lots of terrorists are going to die …and will die very fast

    October 29, 2019
    Reply
  76. Neko014 said:

    This will be useful in military practice

    October 29, 2019
    Reply
  77. borna said:

    I smell military here…

    October 29, 2019
    Reply
  78. zsolti_HUNI said:

    I knew he was hungarian

    October 29, 2019
    Reply
  79. Michael G said:

    Military uses this to see through walls then it's over for Normal warfare.

    October 29, 2019
    Reply
  80. Some Dude said:

    Report>wallhacks

    October 30, 2019
    Reply
  81. Abdullah Sa'adeh said:

    imagine tracking hostage situations with this technology, and shooting the robers through the walls.

    October 30, 2019
    Reply
  82. Max Phillips said:

    In b4 someone writes a router virus that can track you in your home using your Wi-Fi

    October 31, 2019
    Reply
  83. The Fox said:

    By the way, WiFi uses microwaves. Now remember how all the media chuckle heads reacted when Trump said microwaves were being used to spy on people through walls.

    October 31, 2019
    Reply
  84. TheCreaterKeygen said:

    Fucking wall-hackers, called it!

    October 31, 2019
    Reply
  85. DEAD ACCOUNT said:

    So… wallhack?

    November 1, 2019
    Reply
  86. Googler said:

    This is so memeable.

    November 2, 2019
    Reply
  87. Paras said:

    wow

    November 3, 2019
    Reply
  88. AmfistomosAtlas said:

    Ban the wall hack cheaters!!! xP

    November 4, 2019
    Reply
  89. Felixcesar15 said:

    finally xray hack on reality!

    i hope it wont be patched in next update

    November 4, 2019
    Reply
  90. Krishankant Sharma said:

    I want to join you is there any career opportunity.

    November 10, 2019
    Reply
  91. Ali107 said:

    o_o Skynet is coming…

    November 12, 2019
    Reply
  92. Leon Julien said:

    I got a terminator dark fate add.

    November 14, 2019
    Reply
  93. Herman Groenenboom said:

    Didn't warn me to hold on to my papers, now I dropped them in amazement

    November 14, 2019
    Reply
  94. Hi Reddit said:

    The future is here since 1 year ago

    November 15, 2019
    Reply
  95. Lou said:

    Combine this with autonomous lethal weapon (armed drones) and humanity is gone. Maybe this is why we don't find life in the universe: Someone always achieves to wipe us all.

    November 16, 2019
    Reply
  96. Idias said:

    plot twist: that haunting skeleton is the actual person

    November 16, 2019
    Reply
  97. musa mies said:

    I can see my privacy running away from me

    November 17, 2019
    Reply
  98. Roverson Melo said:

    Yeah… thanks for giving Skynet 'x-ray' vision!

    December 8, 2019
    Reply
  99. Jacob Ellinger said:

    Could this be used in radio telescopes?

    December 15, 2019
    Reply
  100. Wes Small said:

    Wow, we actually need tinfoil hats now

    December 19, 2019
    Reply

Leave a Reply

Your email address will not be published. Required fields are marked *