🗣 Picture this: sometime in 2019 a man walked into the Nike store in Pasadena, California. He was a runner, it was a running-centric store, and he was there to buy a pair of running shoes just like the ones he had worn in the past. The clerk asked him if he’d be willing to have his feet measured a new way. “I’m a 9,” the runner said. “I’ve always been a 9. Just give me a 9.” Still, he relented. The runner walked out with a size 10.
What size shoe do you wear? Wait, let’s make that more specific. What size Nike do you wear? Depending on the model you’re talking about—Air Max, Jordans, Air Force Ones, a bootie-like shoe like a Flyknit Vapormax, or even a soccer cleat or other specialized performance shoe—you might be looking at a range of one and a half sizes. That’s due to a bunch of different factors: the shape of your foot, the materials of the shoe, the lacing or stitching pattern, even personal preference. That Pasadena store was one of three locations stealth-testing a technology the company calls Nike Fit—a system that takes all those factors into account and tells you exactly what size you really are, in any shoe Nike makes.
The company estimates that 60 percent of people wear the wrong size, which is why the decided it would be stealth no longer. Since 2019, whenever you walk into a Nike retail store in the US, an employee is able to scan your feet and tell you exactly what size you are, in any shoe Nike makes. If you’re at home, you are able to do it yourself inside the Nike app, courtesy of your smartphone—and the AR capability contained therein.
🗣 Since the 14th century or so, cobblers created different shoes based on lasts, solid shapes that attempted to approximate the morphology of the human foot. The length of those lasts was sized in increments of the barleycorn. Seriously. According to the Composition of Yards and Perches, a medieval English system governing unit of measurements, three barleycorns constituted an inch. (If you really want to kill at a cocktail party, tell folks that it takes four or five poppyseeds to make one barleycorn.) The longer a last got, the wider it got as well, and … well, that was basically it as far as customization goes.
As you can probably imagine, there’s one big problem with a last—especially the one that Michael Martin, Nike’s VP of digital products, slides across a table. The last is transparent and embedded within it is a yellow plastic foot created from a 3D scan. Mostly within, at least: The instep smashes visibly against the edge of the last, and at the base of the big toe the yellow foot extrudes outside of the last. “If the shoe that was designed around that last was designed with one of our more flexible fabrics, then that toe is not going to be such a problem,” Martin says. “If it’s a basketball shoe—even, like, an Air Jordan 1, made out of leather—then that toe is going to end up in a world of pain pretty quickly.”
Like a lot of other shoe companies, Nike’s been trying to improve fit for decades. When Bill Bowerman and Phil Knight founded Nike back in the mid-’60s, Bowerman, a track coach, used to trace runners’ feet and then customize lasts to design shoes specifically for them. As the technology got better, Nike would take 3D scans of athletes’ feet and in 2000 tried something new with the Air Presto, a “T-shirt for your feet” that threw away conventional shoe sizes in favor of a clothing-like S/M/L/XL system. (While the original Presto was comfortable, Martin allows, it didn’t really give the security you’d want for most sports). In recent years, the company created its Adapt self-lacing technology for what it sees as the next generation of fit. But none of those things solves the original problem—not every shoe is going to fit every foot the same way.
🗣 Meanwhile, augmented reality was shouldering its way into the mainstream. Nike saw AR’s potential to help with fit, but the company knew it would need an assist. Looking to the world of startups, Nike found the help it needed in a Tel Aviv company called Invertex.
Invertex, which had originally been founded to make custom orthotics, soon figured out that it could use machine learning and computer vision to do something much more difficult—get as much information about your foot using a smartphone camera as a laser 3D scanner could. Not just length and width but shape, volume, and other categories that help determine your overall morphology.
When Nike acquired Invertex in April 2018, it didn’t say much, beyond that the startup would “focus on building groundbreaking innovations.” Behind the scenes, though, Invertex was working with Nike’s preexisting sports research laboratories to supercharge the process. Within six months, they were ready to start testing the technology in stores in Pasadena, Seattle, and Dallas.
The in-store and at-home versions of Nike Fit is quite similar, though not identical. The cooler bit, arguably, happens at home. While Pokémon bouncing around in a park are cool, and seeing how a couch might look in your living room could come in handy, this feels like a remarkably useful application of phone AR. If you’re a Nike+ member using the Nike app and you select “choose my size” on a sneaker you’re considering, the app presents you with a camera icon and the word “Try It.”
Let’s dive deeper in to how it works!
🗣 Nike’s app uses an augmented reality tool that measures your feet so that it can sell you sneakers that actually fit.
While this may seem like a frivolous use of AR technology, the idea is sound. Buying shoes online is difficult, mainly because you can’t try them on to see if they fit right. Plus, brands lie about sizes, so you can never really be sure. For example, you may be a size 12 in one brand but a size 11 in another brand.
Nike shoes in particular, famously run small in most styles, making them extra hard to buy even if you do happen to have a Brannock device handy to know your foot’s measurements down to the millimeter.
With this AR feature, Nike can measure each foot individually — the size, shape, and volume — with accuracy within 2 millimeters and then suggest the specific size of Nike shoe for the style that you’re looking at. It does this by matching your measurements to the internal volume already known for each of its shoes, and the purchase data of people with similar-sized feet.
It’s not just a one-time gimmick, either: Nike integrated this into its app as a primary feature for measuring shoes, and it is available in its retail stores as well, which speaks to the company’s confidence in the method.
The app gives you a few quick guidelines—take off your shoes, wear contrasting socks, find a clean wall, make sure the room is adequately lit—then prompts you to scan the room with your phone so it can find a place for you to stand. On the screen, you drag a blue line to match where the wall meets the floor, then move to that space and place your heels flush against the wall. Point your phone’s rear camera at your feet and the scan begins.
Inside the app, a machine learning algorithm has a representation of every interior volume for every model in every size, as well as representations of those other fit-affecting elements—materials, stitching, lacing, and so on—so when the scan is complete, the app displays a couple of exact measurements for each of your feet, as well as what it deems your ideal size in that particular sneaker. Or any other Nike kick you might end up considering.
In a store, Nike employees use an iPod Touch to guide customers through the process, though rather than standing against a bare wall (which isn’t so easy to come by in a retail establishment) you stand on a dedicated mat, covered with a grid pattern to let the app better calibrate its measurements.
👀 Let’s go through the process!
So, the Nike Fit scan informs you which would your perfect size in most Nikes will fall. Let’s say it tells you it goes between 9.5 and 10.5. But there’s just one problem: You’ve never worn a 10 in my life, let alone a 10.5. “Maybe you like your shoes tighter than average?” the employer suggests. You don’t, but you agree to take Nike Fit’s advice and try on an Air Force One ’07 in a 9.5. The AF1 in particular is a cavernous silhouette—big in both the heel and the toebox—and your feet swim in them. No problem: the store employee taps in that you prefer a 9 in the AF1, and it notes that change to your Nike+ account.
Things go much more smoothly with a pair of Epic React Flyknit 2. The socklike upper feels perfect in a 9.5, so Slocum registers that as well. What is way better is that with each model you confirm in a given size, the system begins “to learn and understand and then evolve a recognition, not just of how people normally prefer to have their fit in that individual model but how you on a personal basis prefer your fit, in general but also within an individual sport category.”
The rollout of this tech will continue for some time. Your favorite sneaker might not be self-lacing yet, but the company hopes that in the meantime, you’ll find the perfect fit.