August 25, 2019 100

How Does Your Phone Know This Is A Dog?

How Does Your Phone Know This Is A Dog?

Nat: Hi, I’m Nat.
Lo: and I’m Lo. And this is our 20% project where we go find out about
different Google stuff we’re curious about. Nat: Last year,
we got to make a documentary about how voice search works. And that was the first time
we heard about something called
machine learning. Lo: Since then, we’ve been
kind of fascinated by it. Nat: So today we’re talking
with Greg and Chris to learn more about it. How would you describe
machine learning to someone? Chris: Well,
there’s a lot of problems that’s really easy to solve
with computers. Computers can go and, like,
simulate how galaxies move and how the courses
of asteroids going and how close
they’re gonna come to Earth. I could never
hope to go and do that, but I can go
and do this problem, like, recognizing that that’s a tree, which is so much tremendously
more difficult for a computer. Greg: It doesn’t feel like
intelligence to us, because it’s so effortless
as a human being to do it, but for a computer,
it’s actually really hard. Lo: Because the real world
is kind of messy and unpredictable at times, the strict logical rules that go into traditional programming
just don’t work. Chris: Instead of
going and writing programs that solve the problem,
we write programs that learn to solve the problem
from examples. Greg: And it’s
this process of learning that allows them
to improve over time and to actually be more clever
than they would be if we wrote down
a very rigid set of instructions for them to follow. Nat: Machine learning is in so many different things
that we use today that it’s kind of like
this invisible magic ingredient. Greg: Phones with the ability
to understand human speech. Nat: Machine translation,
email spam filters. Lo: When you go to the ATM
and you give a check and it can read the handwriting. Nat: Or a photos app that can automatically
organize your photos based on the things that
you like to take photos of. Like, “Here are all
my mountain photos. Here are all my food photos.” Lo: “Here are all my
dog photos.” Nat: “Here are all my
feet photos.” Chris: Everything
from facial recognition to going and trying to recognize
whether a particle’s present in a particular collision
at the LHC. Nat: Which–we would just like
to take a time-out to say– is that big tube in the ground
over in Europe that smashes particles together
at really fast speed so that scientists
can use that information to unlock
the mysteries of the universe, among other cool things. Now back to our episode, ’cause I am getting
really dizzy doing this. Whoo.
Whoo. Lo: So researchers
and scientists are still experimenting and trying to find the best ways to teach computers how to learn. But a lot of the progress
is coming from these algorithms that are based roughly
on how the human brain works. And these are called
artificial neural networks. Greg: So the artificial
neural network is something that it’s
a rough mathematical cartoon of how a biological
neural network works. In a biological brain, we have individual cells
called neurons. Each neuron looks at
what its neighbors has to say and then decide
what it wants to say. And in artificial
neural networks, we have little
mathematical functions. We put them
in some organized structure, and then we say, “Okay, you guys all together
learn to do this task.” Chris: We have
lots of neural networks that are really great at
going and recognizing, you know, this is a cat; this is a dog;
this is a frog; this is a mouse; this is a horse; this is a
truck, and things like that. Nat: So take for example trying
to recognize what this is. Chris: So it used to be
that we were really proud if we could get a neural net
with three layers to work. And it’s recently that
we’ve made a lot of progress on techniques that allow us to
train much deeper neural nets. Nat: And that’s why
this kind of machine learning is also called deep learning. A neuron in the bottom layer
is just gonna be looking at a tiny piece of the picture and making some computations
about it. It doesn’t understand anything
about dogs specifically. Greg: But what the neuron does
understand is, it says, “I’m giving a signal
that’s useful for somebody “who’s giving a signal
who’s giving a signal who’s giving a signal
who’s giving a signal.” Chris: They’re kind of
able to unfurl this really
high dimensional knot and pull it apart and make it easier to go and,
you know, separate different things
that are– are close together
on the surface from things that are– were tangled
all together earlier. Greg: But then at the top, we’ll put two neurons. And these neurons look
at the whole picture so far. Nat: They’re basically experts
at making the final call, figuring out, “Oh, “all the layers below me
said these things, “so I know that this is a dog
or at least I’m 92.4% sure that it’s a dog,
so it’s basically a dog.” Lo: And while there’s been
a whole lot of progress with teaching computers
to learn, they’re still much slower
learners than we are and they make mistakes
that you and I wouldn’t. Chris: So what I was working on is sort of trying
to find a way to go and look at a neural net
and ask, “What does the neural net think
the platonic ideal of a cat is or the platonic ideal of a dog
or anything it can classify”? And suddenly, you can go
and ask, you know, “Neural net, what do you think
cat looks like?” You get a picture of a cat or,
you know, “Neural net, what do you think
a barbell looks like?” These weights. And it goes
and it shows you a picture not only of a barbell, but
of an arm attached to a barbell. So the model thought
that the arm was, you know– It only learned
what barbells were from looking
at pictures of barbells, and they’re often held
by muscular weight lifters. And so–so it learned
that there was– You know, barbells
have arms attached to them. Greg: It takes them
a long time to learn. You show it
a picture of a school bus. [horn honks] When it’s early in learning,
the very next time you show it a picture
of a school bus… [horn honks] it’s only
a little bit more likely to say “school bus.” It doesn’t get it even though that was
the very last thing it saw. Whereas, you know,
you say to a kid, you know, “That’s a filing cabinet.” And then a second later,
you say, “What’s that?” He’s not gonna be like,
“Shoe,” right? You know– Lo: Well, like,
the more you describe this, the more I’m amazed
by human beings. Greg: Yeah. Lo: Like, the effect is,
like, “Wow. Human beings
are really amazing.” Greg: We’re really amazing
learning machines. [soft squeal] [low grunt] [mimics bark] [soft squeal]

100 Replies to “How Does Your Phone Know This Is A Dog?”

  • water_skipper says:

    How many layers is a human brain?

  • Parag Nainani says:

    Awesome video!
    Will you please elaborate the tech of voice recognition in the next video.

  • Parag Nainani says:

    Awesome video!
    Will you please elaborate the tech of voice recognition in the next video.

  • Parag Nainani says:

    Awesome video!
    Will you please elaborate the tech of voice recognition in the next video.

  • Nat and Friends says:

    Parag, here’s the documentary that we worked on about how voice search works:

  • jamie marchant says:

    It really does show how great the human brain is.

  • Jonathan Hill says:

    Another awesome video :). That dancing brain though, it needs a tumblr, or a tee-shirt.

  • Wade S says:

    I had never thought of the computer "neurons" as code functions. It seemed to me as if they'd need to use some sort of transistor that can change size to simulate neurons. Cool!

  • Sourabh Agarwal says:

    #NatAndLo as always Learnt so much more about "Machine Learning" & "Deep Learning"

    And we would also love to know about where your skill sets are applied at Google.
    (burning question: what do you do at the Big G?)

    Would love to know the story behind the major Google Logo re-branding, please make a video on that.

  • V Durga says:

    How do I join the AMA event scheduled for 1 pm PDT on Sep 25th.
    The link above takes to the calendar event AND the calendar event does not have details.

  • James Nixon Steel says:

    Greg was so cute. also great video!

  • Jonathan Goggans says:

    I want to lern more about projects Soli!!!

  • Enrique Cubillo says:

    What do you think a full body, transport sport, that works strength-endurance – balance for a life time- right out the door looks like? Oh yes and is one of only two, of the highest human output race sports on earth. And born on an American Iconic device. Also born at the hands of one person. Also the only race sport that will ever have begun in the daredevil theater and have evolved into the endurance theater? Oh yes and of course the innovation remains the same as long as humans remain in the physiological form as they are. Solve for X? Is X is sedentary lifestyle then why do we indoctrinate the US public with football , baseball soccer , hockey and basketball? Would be like teaching typing and clerical skill sets instead of teaching code? No one will ever use field sport movement language after age 19 for any daily use. Transport sports. SpikeBoarding is one of the greats…. and it was born right next door to Google NYC.

  • Keyur Shah says:

    Awesome video guys! Thanks for posting. You really explained the process very intuitively! Truly inspirational, should be shown in schools!!

  • Tarun Bafna says:

    reallly cool… never saw such a simpler explanation for such a topic…

  • Saifuddin Ahmed says:


  • Dayvid Victor says:

    Finally a way to explain my non-scientist friends what in the world is Deep Learning. 🙂

  • Yash Trivedi says:

    that's an excellent vid and the dog in the end was super cute!! 🙂

  • Andrew Krause says:

    "what is this?"

  • Alain Lafond says:

    Hehe…. Thanbk you for making me feel a little more clever…. We need more of those videos that explain VERY complicated knowledge.

  • Mattia Delpopolo says:

    that iPhoneeee ://

  • Ankit Raj says:

    Beaut-ies with Brain-s:-D

  • Ana Batista says:

    agradesco a Dios por este gran paso en el desarrollo de nuevas tegnologias ,) no cave dudas que los seres humano somos grande y que cuando queremos podemos lograr cosas tangrade como esas ,muchas vendiciones equipo google. Dios los ilumine siempre soy muy feliz potodo es to gracias…palante.

  • Alex Wohlbruck says:

    1:29 That app opening animation 😀

  • Ed Byrne says:

    that guy is so fucking annoying

  • poke089 says:

    Cute, until it develops self-awareness and starts killing people.

  • AngelLestat2 says:

    who put those people to talk? they are all wrong.
    Right now computers can learn all languages and recognoice all type of pronunciations in few years, how much it would take to a human to do that?

    If you show to a baby a bed for the first time, and then you show them another bed, he will not recoignice what is that.. is only after hundred or thousands of times after see, hear and touch things that we learn about them.

    You can make a neural network with many visual, hearing and touch inputs with less definition inputs than our senses with its own movement devices, and the machine learning will learn faster than a human to recognize things.
    But they are very carefull to not said this to the public to not alarm them.
    Of course we still need to cross the conscience issue that is our drive, but we can give the machine goals now and it would not need a conscience to learn.

  • ericcartmansh says:

    You're videos have some amazing editing. Must have spent days getting all the animations right and accurate!

  • Lucy Soboleva says:

    What is the app that translates signs to other languages?

  • Jehan Music says:

    Awesome work. Love the video and very happy to see more women killing it in tech. Subbed. 🙂

  • David EarthosVenus says:

    Machine Learning & Deep Neural Networks Explained – #NatAndLo Ep 7

  • Daryl Hendricks says:

    Addictive !!! ^-_-^

  • Gunnar Shaffer says:

    The reason we are such amazing learning machines is because we were not designed by evolution but by an all encompassing and compassionate God who cares for us. 😉

  • Farid Niyazov says:

    Русский коммент!

  • Matt de Neef says:

    I'm a Computer Engineering student, and I did a course in AI, we studied neural networks and even had to design one to classify footprints… But this video was such a great explanation, would have saved me a week of puzzling through a textbook 😛 thanks for the great content !!

  • Muhammad Faheem Mohd Ezani says:

    Cool video! Saved my time trying to get the gist of it 😀

  • David Chester says:

    This is beginning to frighten me not because of errors that the machine "unwittingly" makes but because of those which have deliberately included. It would be so easy, for example, when searching for taxation regimes to omit one of them, which might just be what a government is looking for, but which is "politically incorrect" and which this government is currently unaware about. Such biasing should be eliminated from the machine-learning program by the use of a security checker to search for any introduced "pre-programmed" avoidance of some information of specific kinds of what otherwise appears to be a wonderful technique for sorting out data, otherwise it will soon have us all living in a "brave new world" or even "matrix" situation where we cannot escape from the system!

  • darshanime says:

    Hey, that's Chris Olah right there ! I hope you appreciate him, he is a genius. So lucky to get to meet him just like that.

  • grmmhp says:

    4:25 portuguese <3

  • Sojan Jose says:

    was searching machine learning on youtube . found this video . Ended up watching every video in your channel and its around 4 am here now . guess my sleep is late, today too ?.

    Awesome stuff guys . Keep going . ??

  • Gordon Chin says:

    flashy bullshit.

  • DeepLearning.TV says:

    Hi Nat and Lo! I really like this video that you've created to explain this topic. More importantly, I think that it rocks that one of the top ranked YouTube videos on Deep Learning is by two gals 🙂

    I say that for a reason – my team and I just launched a series on Deep Learning ourselves here on YouTube. While we've gotten a lot of interest, the analytics tell us that the male to female ratio for viewers is 97% to 3%. Even considering the different things would you normally consider with stats, that is not a very good picture. Sadly, it makes sense given the anecdotal knowledge about this field – it is male dominated.

    We created this so it can help everyone. But if the last two weeks are any indication, letting it grow organically is not going to work. So, I wanted to pick your brains and see if you have ideas for us. How can we engage female audiences with our content? I would totally appreciate your thoughts on this :-)!


  • 1 01 says:

    Thanks for making this video. Im studying this in school and this really helped.

  • Guillaume Combot says:

    The rythme is perfect, the content is super well illustrated, thank you!

  • arnab chattopadhyay says:

    that was coooooool!!!!!just love you guys! Nat and lo!!

  • Best Online Courses says:

    Cool Awesome video! Thank you so much for sharing! Love your channel a lot! <3

  • blue azul says:

    only gay people?

  • Eugene Jenson says:

    That was so cool… m/

  • automarine says:

    this dude is so hott. wowee.

  • Richard Benoit says:

    Would it no been too hard to simply say (AI) methods?

  • Anthony.R.Brown A.R.B says:

    The A.R.B GO System + AlphaGo v Lee Sedol – Seoul 2016 – Prediction

  • Tpv tpv says:

    BEST machine learning BOOKS EVER
    Python Machine Learning
    Machine Learning: The Art and Science of Algorithms that Make Sense of Data
    Fundamentals of Machine Learning for Predictive Data Analytics: Algorithms, Worked Examples, and Case Studies (MIT Press)
    Data Science from Scratch: First Principles with Python
    Machine Learning: A Probabilistic Perspective (Adaptive Computation and Machine Learning series)

  • Dan Duncan says:

    If this all sounds abstract, this is a demo of neural nets in action:

  • AngelusMortis1000 says:


  • Amanda Truong says:

    Thanks for the video! It was awesome

  • Matthew Krohn says:

    Nat and Lo:

    As someone going to school in the fall for computer science at SDSMT, a massive fan of everything Google stands for, and a person wanting to work hard to become a part of the Google team I envy and look up to so much, I love these videos. I've already read 'Work Rules' by Laszlo Block and these videos give me even more reason to work even harder. Thank you for giving people like me a chance to see the great and amazing things you people do.

  • Andre Gomes says:

    "unpredictble at times" NOPE! Unpredictble always

  • Mauritz Jameson says:

    OMG – I hate pop-science!!!!!!!!!!!!!!!!!!!!!!!!

  • FirePikachu 123 says:

    Simsimi for example

  • Sommer Sallada says:

    I'm working on a similar process of using Psychology, Sociology, Philosophy, Humansim, Statistical Analysis and Philosophic Logic parameters, definition, relations, correlations and functions to create a new language which would literally be translatable between human and machine, all the way down to emotion, confounding variables and divine intervention as parameters included. It sounds like the two projects would merge well together. I understand the sciences of human behavior and the the mathmatics and logistic language symbolism behind how and why we function. I also have a slight background in computers. I've been looking for someone with the machine language skills to partner with me.

  • mo says:

    I'd LOVE to share this video via our company blog. However, we are having troubling sharing it with the team in China. Would you mind if we copy it to a Chinese video platform?

  • Welt Rogg says:

    When appears AI – programmers go to lose their job forever. Developers deprive themselves job.

  • Arik C says:

    thank you. thank you. thank you. finally I can understand with Deep Learning is!!!!

  • NOUM says:

    They try their best to explain but in the end, you're more confused than ever. Damn nerds

  • rogelio andrade says:

    Hello! Nat&Lo Do you have an email address so I can get in contact with you?

  • Gilmar Oliveira says:

    Obrigado pelas legendas em Português!

  • Gilmar Oliveira says:

    Obrigado pelas legendas em Português!

  • Rd Rz says:

    what about my native languages? hope someone can help speed it up

  • Veli KAYA says:

    AI … interesting, success.

  • Dan Cumberland says:

    Love your videos! Keep up the great work! 🙂

  • Sameer Panigrahi says:

    Make a video on, how internet works please!!!!

  • Top 1Percent says:

    Hey, Nat and Lo. Do you guys work at Google and if yes are you working as machine learning researcher?

  • Jameel Ja says:

    we (humans) are amazing learning machines. but it took us 2 million years to evolve to this. it's only taken computers 60 years to get to where they are. imagine in 20 more years or 10 or beyond.

  • cgm778 says:

    Good explanation. I like how they compare human learning with machine learning. With machine learning there's whole lot of human knowledge that goes into the design of the network and the supplying lots of examples. Human learning is orders of magnitude better than that. AI is great but don't look for the singularity in time soon because achieving that singularity requires so much more that merely expanding computing power.

  • josiah O'Neill says:

    That not a dog. Oh I Know it's cat

  • Android Tweaks says:

    You people deserve 10 million subs. But there are only 86k subs. Why?
    Are you not promoting your channel properly?

  • Krishna Sagar says:

    Watched all your videos in a single stretch..! Awesome work Nat and Lo..

  • Rahul Sargar says:

    i just love your channel

  • Joe Breakwell says:

    sky net

  • Ramanuja Rao says:

    We are amazing learning machines.

  • Bytler says:

    more please 🙂

  • Khairunnisa L says:

    this channel is very underrated

  • Android Son says:
    The simple application to explain how.

  • Ismael Martos says:

    I know this comment isn't related with the topic of the video (the neural networks are amazing by the way) but I have to say that Greg (the man with a black t-shirt) is so so so hot for me ?? pls I'm in love with him hahaha do you know his social networks… 🙂 congrats for your amazing channel

  • 策刘 says:

    What's the app that you use to translate pictures to English?

  • 张恩文 says:

    hope you two beauty post an interview with Christ Olah!really love this guy!

  • 张恩文 says:

    hope you two beauty post an interview with Christ Olah!really love this guy!

  • Edurado Terrazas says:

    Los que Des nos no res con na. Las pes ras. Por favor nos gas los vides nos con ras más. Dos. Nos que ros ves. Nas nes mi pes FES si res nes. Casa nos. Si gas no como si nos si nos Ges nes Des no si nes visi tas na dos la por les más. Gos nos más. Con Mos les pes nos res en para si Vi ras que. Gas ras ves en nes nos Des las Mos nas si con mos pos dos na res las ras. Des mes gas nes vos ma Des nos mes en Que los pes nos res las. Si por si gas pos Cos nos na uno mes Ges nes. Si que ras los nes nos dos por que por mi nos. Que kes si no nes dos nos. Los res las. Si mes los de gos si. Na ras. No no si les dos ños que con pasa ñas na para res los que los nos que los res Ges nes no que nes si

  • Egidio Caleiro Santoro says:

    This video is awesome. I'm two years late, though. "we are really amazing learning machines."

  • Andrea Beretta says:

    Great video! Thanks! 🙂

  • CounterBison4125 says:

    What dog breed is noodles

  • PureLife Tropics says:

    OH MY GOD, what is that SCREACHING loud noise with the video? Seriously! Can't be just my computer. Any ideas?

  • Rehan Arshad says:

    Really tough task …

  • Miaomiao Zhang says:

    Just tried to explain the math behind neural network to my friend!! Imagine your fingers touch the table, they send signals to different parts of your body (coefficients), and different parts of your body have different pain thresholds so they respond to the signals differently (weights); when you push too hard and break your fingers, the pain lingers (feedback loops) ;))

  • Johnny Perez says:

    monsters. developing the next sky net and they don't even know. how do i get onboard?

  • Dmitry Larionov says:

    "Импортные черный фермы подняли икра." – that's fantastic on 1:34 )))) non-sense meaning in russian)

  • Raj Ji says:

    Namaste dear.
    Thanks to your Guideness for meaningful information.

  • Thomas J. Scharmann says:

    Well done.

Leave a Reply

Your email address will not be published. Required fields are marked *

© Copyright 2019. Amrab Angladeshi. Designed by