I have seen the future, and it’s written in Chalk (PTC’s Vuforia Chalk, that is!)

I just had to take time out from my live blogging of PTC’s LiveWorx ’18 to focus on one of the topics Jim Heppelmann mentioned in passing in his keynote: the new variation on the company’s Vuforia AR app: Chalk.

Significant in its own right, I suspect Chalk will have an additional, critical impact: democratizing AR.

It is an app aimed at, and accessible to, both corporate audiences AND the general public.  Downloadable for both iPhone & iPads & Android devices, I suspect that it will quickly become popular both to support remote repair staff for companies and just plain folks who are trying, for example to help a family member far away to deal with a car or plumbing repair. Not to mention the fact (mandatory disclaimer: while I work part-time for Apple, I’m not privy to any corporate internal strategy) that the spiffy new $329 6th-generation iPad really facilitates AR, and Chalk was developed in conjunction with the Apple ARKit technology so it should really become popular.

Chalk has two components:

  • real-time video and voice sharing of the same view
  • Chalk Marks, simple handswipes that allow one of the participants to highlight the part that is the subject of the question.  The “Marks” appear to be anchored to the subjects they’re “drawn” on.

Real-world uses vary from a remote super-expert helping a field technician to identify and deal with a rare problem to your millennial helping Mom master her personal technology. I saw an amazing demo this morning with one mechanic in Germany (ok, he was actually 2′ away…) directing the mechanic working on a Mercedes how to add coolant.  As the press release announcing the app said:

“Today, remote assistance can be frustrating and cumbersome. People struggle for words to describe things that are unfamiliar, whether it be a new appliance or the back of a cable box. And when the problem can’t be described clearly, it becomes almost impossible for someone else to solve. Vuforia Chalk provides a simple and intuitive solution where people can now use Chalk Marks to get a common understanding of a problem, and the steps required to solve it.”

I’ve written before that I suspected many companies got into e-commerce in the 9o’s because a CEO’s kids got him to order a book from Amazon during the holidays & he came back raving about this new device.  I can’t help thinking that this will be just the kind of low-cost (heck, in this case, no-cost) introduction to AR And the IoT that will break down some companies’ skepticism, pay off with immediate bottom line benefits in cost savings and efficiency in service operations, and get them interested in most expensive AR such as PTC’s digital twins and predictive maintenance.  Or, as ABI analyst Eric Abbruzzes said:

“Mainstream augmented reality is at the beginning of a strong positive inflection point, and Vuforia Chalk is a great example of how AR can transition from enterprise-only to use in everyday life,” said Eric Abbruzzese, ABI Research. “We see Vuforia Chalk as a fundamentally disruptive form of remote communication that will be well received across multiple sectors and for multiple use cases.”

Now to get my granddaughter to download the app so we can collaborate on the 3D-printer that I got her for her 12th- birthday!

Wahoo! Liveblogging #Liveworx ’18!

Always my fav event, I’ll be liveblogging #LiveWorx ’18.  Stay tuned!

Keynote: Jim Heppelmann:

  • “from a place to a pace” — how fast are we moving?
  • no longer OK to think of a future destination, builds inertia (“your main competitor”). Disruption may have already happened. Hard to sustain advantage due to pace of change. Must “embrace a pace of change”
  • Um, this sounds like argument for my circular company paradigm shift!!!
  • Customer Experience Center will occupy top floor of new building.
  • combo of  physical, human and digital — transforming all at once speeds change:
    • physical: been constrained by subtractive manufacturing, while nature improves via cell division (i.e., additive). “Adopt Mother Nature’s mindset.” — new additive aspects of Creo. Example of Triumph cycle sing-arm using additive. CREO uses AI to optimize performance: non-symmetrical design. Still need to use simulation tests: new intermittent, continuous style: they are doing new partnership with ANSYS (product simulation software), unified modeling and simulation with no gaps. Historically, simulation only used at end of design cycle, now can use it throughout the process: “pervasive simulation.”
      • ANSYS “Discovery Live”: optimizes for real-time. Integrates with Creo — instant feedback on new designs. “simulation critical to innovation.”
    • digital: working with Microsoft Azure (Rodney Clark, Microsoft IoT VP). Microsoft investing $5b in IoT.  1st collaboration is an industrial welder: IoT data optimizes productivity.  BAE can train new employees 30-40% quicker.
    • finally, human: “Mother Nature designed ups to interface with the physical. How do we integrate with the digital? — Siri, Alexa, Cortna still too slow.  Sight is our best bet. “Need direct pipeline to reality ” — that’s AR. “Smart, connected humans.” Sysmex: for medical lab analysis. Hospitals need real-time access to blood cell analysis. They have real-time calibration of analysis equipment. Also improving knowledge of the support techs, using AR and digital twins when repairs are needed.
      • Will help 2.5 billion workers become more productive
      • AR can project how a process is being programmed (gotta see this one. will try to get video).
      • All of their human/digital interface initiatives united under Vuforia. Already have 10,000 enterprises using it.
    • Factories are a new focus of PTC. 200 companies now using it in 800 factories. Examples from Woodward & Colfax.  Big savings on new employee training.

Keynote: Prof. Linda Hill, HBS, “Collective Genius”:

  • Innovation= novel + useful
  • Example of Pixar: collective genius “filmmaking is a team sport.”
  • 3 characteristics of creative organizations they looked at:
    • “creative abrasion” — diversity and debate
    • “creative agility” — quickly test the idea & get feedback. Experiment rather than run pilots, which often include politics
    • “creative resolution” — ability to make integrative decisions. Don’t necessarily defer to the experts.
    • sense of community and shared purpose.
  • values: bold ambition, collaboration, responsibility, learning.
  • rules of engagement: respect, trust, influence, see the whole, question everything, be data-driven.

Ray Miciek, Aquitas Solutions. Getting Started on IoT-based Maintenance:

  • his company specializes in asset maintenance.
  • “produce products with assets that never fail”
  • 82% of all asset failures are random, because they are more IT-related now
  • find someplace in org. where you could gain info to avoid failure.
  • Can start small, then quickly expand.

 

“All of Us:” THE model for IoT privacy and security!

pardon me in advance:this will be long, but I think the topic merits it!

One of my fav bits of strategic folk wisdom (in fact, a consistent theme in my Data Dynamite book on the open data paradigm shift) is, when you face a new problem, to think of another organization that might have one similar to yours, but which suffers from it to the nth degree (in some cases, even a matter of literal life-or-death!).

That’s on the likelihood that the severity of their situation would have led these organizations to already explore radical and innovative solutions that might guide your and shorten the process. In the case of the IoT, that would include jet turbine manufacturers and off-shore oil rigs, for example.

I raise that point because of the ever-present problem of IoT privacy and security. I’ve consistently criticized many companies’ lack of attention to seriousness and ingenuity, and warned that this could result not only in disaster for these companies, but also the industry in general due to guilt-by-association.

This is even more of an issue since the May roll-out of the EU’s General Data Protection Regulation (GDPR), based on the presumption of an individual right to privacy.

Now, I have exciting confirmation — from the actions of an organization with just such a high-stakes privacy and security challenge — that it is possible to design an imaginative and effective process alerting the public to the high stakes and providing a thorough process to both reassure them and enroll them in the process.

Informed consent at its best!

It’s the NIH-funded All of Us, a bold effort to recruit 1 million or more people of every age, sex, race, home state, and state of health nationwide to speed medical research, especially toward the goal of “personalized medicine.” The researchers hope that, “By taking into account individual differences in lifestyle, environment, and biology, researchers will uncover paths toward delivering precision medicine.”

All of Us should be of great interest to IoT practitioners, starting with the fact that it might just save our own lives by leading to creation of new medicines (hope you’ll join me in signing up!). In addition, it parallels the IoT in allowing unprecedented degrees of precision in individuals’ care, just as the IoT does with manufacturing, operating data, etc.:

“Precision medicine is an approach to disease treatment and prevention that seeks to maximize effectiveness by taking into account individual variability in genes, environment, and lifestyle. Precision medicine seeks to redefine our understanding of disease onset and progression, treatment response, and health outcomes through the more precise measurement of molecular, environmental, and behavioral factors that contribute to health and disease. This understanding will lead to more accurate diagnoses, more rational disease prevention strategies, better treatment selection, and the development of novel therapies. Coincident with advancing the science of medicine is a changing culture of medical practice and medical research that engages individuals as active partners – not just as patients or research subjects. We believe the combination of a highly engaged population and rich biological, health, behavioral, and environmental data will usher in a new and more effective era of American healthcare.” (my emphasis added)


But what really struck me about All of Us’s relevance to IoT is the absolutely critical need to do everything possible to assure the confidentiality of participants’ data, starting with HIPP protections and extending to the fact that it would absolutely destroy public confidence in the program if the data were to be stolen or otherwise compromised.  As Katie Rush, who heads the project’s communications team told me, “We felt it was important for people to have a solid understanding of what participation in the program entails—so that through the consent process, they were fully informed.”

What the All of Us staff designed was, in my estimation (and I’ve been in or around medical communication for forty years), the gold standard for such processes, and a great model for effective IoT informed consent:

  • you can’t ignore it and still participate in the program: you must sign the consent form.
  • you also can’t short-circuit the process: it said at the beginning the process would take 18-30 minutes (to which I said yeah, sure — I was just going to sign the form and get going), and it really did, because you had to do each step or you couldn’t join — the site was designed so no shortcuts were allowed!:
    • first, there’s an easy-to-follow, attractive short animation about that section of the program
    • then you have to answer some basic questions to demonstrate that you understand the implications.
    • then you have to give your consent to that portion of the program
    • the same process is repeated for each component of the program.
  • all of the steps, and all of the key provisions, are explained in clear, simple English, not legalese. To wit:
    • “Personal information, like your name, address, and other things that easily identify participants will be removed from all data.
    • Samples—also without any names on them—are stored in a secure biobank”
    • “We require All of Us Research Program partner organizations to show that they can meet strict data security standards before they may collect, transfer, or store information from participants.
    • We encrypt all participant data. We also remove obvious identifiers from data used for research. This means names, addresses, and other identifying information is separate from the health information.
    • We require researchers seeking access to All of Us Research Program data to first register with the program, take our ethics training, and agree to a code of conduct for responsible data use.
    • We make data available on a secure platform—the All of Us research portal—and track the activity of all researchers who use it.
    • We enlist independent reviewers to check our plans and test our systems on an ongoing basis to make sure we have effective security controls in place, responsive to emerging threats.”

The site emphasizes that everything possible will be done to protect your privacy and anonymity, but it is also frank that there is no way of removing all risk, and your final consent requires acknowledging that you understand those limits:

“We are working with top privacy experts and using highly-advanced security tools to keep your data safe. We have several  steps in place to protect your data. First, the data we collet from you will be stored on=oyters with extra security portection. A special team will have clearance to process and track your data. We will limit who is allowed to see information that could directly identy you, like your name or social security number. In the unlikely event of a data breach, we will notify you. You are our partner, and your privacy will always be our top priority.”

The process is thorough, easy to understand, and assures that those who actually sign up know exactly what’s expected from them, what will be done to protect them, and that they may still have some risk.

Why can’t we expect that all IoT product manufacturers will give us a streamlined version of the same process? 


I will be developing consulting services to advise companies that want to develop common-sense, effective, easy-to-implement IoT privacy and security measures. Write me if you’d like to know more.

Previewing “The Future Is Smart”: 1) Collective Blindness and the IoT

This is the first of an occasional series of posts preceding the August 1st publication of The Future Is Smart. The book will introduce the Internet of Things to business audiences and help them create affordable, profitable strategies to revolutionize their products, services, and even their very way of doing business through the IoT.  Each post will excerpt part of the book, giving you enough detail to be informative, but not — LOL — complete enough that you’ll be able to skip buying the book itself!

The critical point the book makes about revising your products and services to capitalize on the IoT is that it’s not enough to simply install sensors and beef up your data analysis: equally important are fundamental attitudinal shifts to break free from the limits of past technology and realize the IoT’s full capability.

A critical component is what I call “Collective Blindness,” a way of describing how limited we were in understanding how products actually ran in the era when we had almost no data about their operations, let alone real-time data that we (or other machines, through M2M controls) could act on instantly to create feedback loops and improve operating precision and facilitate upgrades.

Let me know what you think (after an horrific hack, I’ve decided to scrap comments on the blog — if I think it’s merited, I’ll feature your feedback in future posts)!


Technologist Jeffrey Conklin has written of “wicked problems” that are so complex they aren’t even known or detailed until solutions to them are found.

What if there had been a wicked problem, a universal human malady that we’ll call “Collective Blindness,” whose symptoms were that we humans simply could not see much of what was happening in the material world? We could only see the surface of these things, while their interiors and actual operations were impenetrable to us. For millennia we just came up with coping mechanisms to work around the problem of not being able to peer inside things, which we accepted as reality.

Collective Blindness was a stupendous obstacle to full realization of a whole range of human and business activities. But, of course, we couldn’t quantify the problem’s impact because we weren’t even aware that it existed.

In fact, Collective Blindness has been a reality, because vast areas of our daily reality have been unknowable and we have accepted those limits as a condition of reality.

For example, in a business context:

  • We couldn’t tell when a key piece of machinery was going to fail due to metal fatigue.
  • We couldn’t tell how efficiently an assembly line was operating, or how to fully optimize its performance by having changes in one machine trigger adjustments in the next one.
  • We couldn’t tell whether or when a delivery truck would be stuck in traffic, or for how long.
  • We couldn’t tell exactly when we’d need a parts resupply shipment from a supplier. (Let’s be honest: What we’ve called “just-in-time” in the past was hopelessly inexact compared to what we’ll be able to do in the future.) Nor would the supplier know exactly when to do a new production run in order to be ready.
  • We couldn’t tell how customers actually used our products once they were in the field, or help those customers adjust operations to make them more efficient.

That’s all changing now.

The wicked problem of Collective Blindness is ending, because the Internet of Things solves it, giving us real-time information about what’s happening inside things.

The Internet of Things will affect and improve every aspect of business, because it will allow us to eliminate all of those blind spots resulting from Collective Blindness, achieve efficiency, and derive insights that were impossible before.

Cisco, which focuses not only on the IoT’s enabling technologies but also on the management issues it will address, understands the Collective Blindness concept. It refers to previously opaque and unconnected things as “dark assets,” and says that, “The challenge is to know which dark assets (unconnected things) to light up (connect) and then capture, analyze, and use the data generated to improve efficiency while working smarter.”

Vuforia “sees” inside Caterpillar device

PTC has created the most literal cure for Collective Blindness: Vuforia, an AR system that lets an operator or repair person wearing an AR headset or using a tablet to go from looking at the exterior of a Caterpillar front-end loader to “seeing” an exploded view of the system that shows each part and how they connect as well as monitoring the realtime performance data of each component, gathered by sensors on the machinery. That insight can also be shared, in real-time, by others who need it.


You may quibble with my choice of the “Collective Blindness” metaphor for the obstacles we and businesses in general, faced before the IoT, but I do think we need some sweeping description of exactly how limited we used to be because the acceptance of those limits, and our inability to “see” how things really did restrict our ability to fine-tone products and their operation — and even now may keep us from re-examining everything now that we have gained this ability. Let me know your thoughts on this — and I hope you’ll stay tuned for more excerpts from The Future Is Smart in coming months.

 

Why IoT Engineers Need Compulsory Sensitivity Training on Privacy & Security

Posted on 4th April 2018 in AI, data, Essential Truths, Internet of Things, privacy, security

OK, you may say I’m over-sensitive, but a headline today from Google’s blog that others may chuckle about (“Noodle on this: Machine learning that can identify ramen by shop“) left me profoundly worried about some engineers’ tone-deaf insensitivity to growing public concern about privacy and security.

This is not going to be pleasant for many readers, but bear with me — IMHO, it’s important to the IoT’s survival.

As I’ve written before, I learned during my work on corporate crisis management in the 80’s and 90’s that there’s an all-too-frequent gulf between the public and engineers on fear.  Engineers, as left-brained and logical as they come (or, in Myers-Briggs lingo, ISTJs, “logical, detached and detailed” and the polar opposite of ENFP’s such as me, ” caring, creative, quick and impulsive” ) are ideally-suited for the precision needs of their profession — but often (but not always, I’ll admit…) clueless about how the rest of us respond to things such as the Russian disruption of our sacred political institutions via Facebook or any of the numerous violations of personal privacy and security that have taken place with IoT devices lacking in basic protections.

The situation is bad, and getting worse. In one Pew poll, 16% or less of Americans felt that a wide range of institutions, from companies to government, were protecting their information.

Engineers are quick to dismiss the resulting fear because it isn’t logical.  But, as I’ve written before, the fact fear isn’t logical doesn’t mean it isn’t really real for many people, and can cloud their thought processes and decision-making.

Even worse, it’s cumulative and can ensnare good companies as well as bad.  After a while, all the privacy and security violations get conflated in their minds.

Exhibit A for this insensitivity? The despicable memo from Facebook VP Andrew Bosworth:

““Maybe someone dies in a terrorist attack coordinated on our tools. And still we connect people. The ugly truth is that we believe in connecting people so deeply that anything that allows us to connect more people more often is *de facto* good.”

Eventually he, begrudgingly, apologized, as did Mark Zuckerberg, but, IMHO that was just facesaving. Why didn’t anyone at Facebook demand a retraction immediately, and why did some at Facebook get mad not at Bosworth but instead at anyone who’d leak such information?  They and the corporate culture are as guilty as Bosworth in my mind.

So why do I bring up the story about identifying the source of your ramen using AI, which was surely written totally innocently by a Google engineer who thought it would be a cute example of how AI can be applied to a wide range of subjects? It’s because I read it — with my antennae admittedly sharpened by all the recent abuses — as something that might have been funny several years ago but should have gone unpublished now in light of all the fears about privacy and security. Think of this little fun project the way a lot of the people I try to counsel on technology fears every day would have: you mean they now can and will find out where I get my noodles? What the hell else do they know about me, and who will they give that information to???

Again, I’m quite willing to admit I may be over-reacting because of my own horror about the nonchalance on privacy and security, but I don’t think so.

That’s why I’ll conclude this screed with a call for all IoT engineers to undergo mandatory privacy and security training on a continuing basis. The risk of losing consumer confidence in their products and services is simply too great for them to get off the hook because that’s not their job. If you do IoT, privacy and security is part of the job description.

End of sermon. Go about your business.

 

 

comments: Comments Off on Why IoT Engineers Need Compulsory Sensitivity Training on Privacy & Security tags: , , , ,

Holy Clayton Christensen! Is Local Motors prototype for future of manufacturing?

In the latter stages of writing The Future Is Smart, I came across Local Motors, an amazing company that is not only an IoT innovator but also might pr0vide a model to revolutionize American manufacturing in general.

I’d read an article years ago about the company when it was locally-based, but since it was focused entirely on off-road & fast cars at the time (both of which leave me cold) I didn’t follow up.

Now it’s diversifying into a cute small urban shuttle device, the Olli, which is being produced at Local Motion’s Knoxville microfactory, taps IBM’s Watson, and which they label “the world’s first self-driving cognitive vehicle.” Very cool.

co-creation

The first of Local Motor’s revolutionary aspects is its design process, which it labels “co-creation” (AKA crowdsourcing — in fact founder/visionary John B. (Jay) Rogers, Jr. says he was inspired by the Jeff Howe book of the same name). It uses a SaaS platform, where the company posts design challenges, and then community members (some experts, some just enthusiasts) offer their ideas. Eventually, the community votes on which designs to actually produce:

“An active process where brands and their customers work together with solvers, designers, and engineers to accelerate product and technology development. We call this group our Community and proudly work to empower genius ideas and brilliant solutions from Community members across the globe.”

The participatory aspect even extends to the shop floor: buyers can opt to personally take part in the final assembly process (and designs are also easily customized after the sale as well).

The company has also provided consulting services on co-creation for organizations ranging from the US Army to Airbus. 

This is not unlike my “share data, don’t hoard it” IoT Essential Truth, which is also at the heart of my Circular Company vision: when you involve and empower a wide range of people, you can unleash creativity that even the most talented person can’t.

direct digital manufacturing

The second Local Motors innovation is use of creative technologies, especially 3D printing, in manufacturing, what they call “direct digital manufacturing (DDM).”  The process mimics what Siemens does at its “Factory of the Future,”  where complete digitalization gives them quality, precision, and the opportunity for mass customization:

“DDM creates significant unfair advantages: the ability to produce parts directly from a CAD file; elimination of investments in tooling; reduction in time lag between design and production and, best of all, elimination of penalties for redesigns — unlocking mass customization that was previously unobtainable.”

According to Chief Strategy Officer Justin Fishkin, the economies possible with the DDH approach means the Rally Fighter model was profitable after only the 60th one was built.

microfactories

I’ve written before about Ford’s River Rouge plant, the ne plus ultra of the first Industrial Age: iron ore went in one end of the 1 x 1.6 mile factory and Model Ts came out the other.

By contrast, Local Motors is building several supermarket-sized “microfactories” around the globe at a cost 1/100th of that for conventional car plants, which “..will also act as points of sale, or what Fishkin calls ‘experiential dealerships.’”

 


The jury’s still out on Local Motors (Rogers, for example, has come in for some scathing tell-all comments by former employees), but even if it isn’t a roaring success, it will have a lasting legacy for challenging such long-held assumptions about the entire design/build process. and for exploiting the full benefits of digitization.  It’s the essence of Christensen’s disruptive innovation.

We’ll be watching

 

comments: Comments Off on Holy Clayton Christensen! Is Local Motors prototype for future of manufacturing? tags: , , , , , , ,

Great Podcast Discussion of #IoT Strategy With Old Friend Jason Daniels

Right after I submitted my final manuscript for The Future is Smart I had a chance to spend an hour with old friend Jason Daniels (we collaborated on a series of “21st Century Homeland Security Tips You Won’t Hear From Officials” videos back when I was a homeland security theorist) on his “Studio @ 50 Oliver” podcast.

We covered just about every topic I hit in the book, with a heavy emphasis on the attitude shifts (“IoT Essential Truths” needed to really capitalize on the IoT and the bleeding-edge concept I introduce at the end of the book, the “Circular Corporation,” with departments and individuals (even including your supply chain, distribution network and customers, if you choose) in a continuous, circular management style revolving around a shared real-time IoT hub.  Hope you’ll enjoy it!

comments: Comments Off on Great Podcast Discussion of #IoT Strategy With Old Friend Jason Daniels tags: , , , , , ,

IoT Design Manifesto 1.0: great starting point for your IoT strategy & products!

Late in the process of writing my forthcoming IoT strategy book, The Future Is Smart, I happened on the “IoT Design Manifesto 1.0” site. I wish I’d found it earlier so I could have featured it more prominently in the book.

The reason is that the manifesto is the product (bear in mind that the original team of participants designed it to be dynamic and iterative, so it will doubtlessly change over time) of a collaborative process involving both product designers and IoT thought leaders such as the great Rob van Kranenburg. As I’ve written ad nauseam, I think of the IoT as inherently collaborative, since sharing data rather than hoarding it can lead to synergistic benefits, and collaborative approaches such as smart cities get their strength from an evolving mishmash of individual actions that gets progressively more valuable.

From the names, I suspect most of the Manifesto’s authors are European. That’s important, since Europeans seem to be more concerned, on the whole, about IoT privacy and security than their American counterparts, witness the EU-driven “privacy by design” concept, which makes privacy a priority from the beginning of the design process.

At any rate, I was impressed that the manifesto combines both philosophical and economic priorities, and does so in a way that should maximize the benefits and minimize the problems.

I’m going to take the liberty of including the entire manifesto, with my side comments:

  1. WE DON’T BELIEVE THE HYPE. We pledge to be skeptical of the cult of the new — just slapping the Internet onto a product isn’t the answer, Monetizing only through connectivity rarely guarantees sustainable commercial success.
    (Comment: this is like my “just because you can do it doesn’t mean you should” warning: if making a product “smart” doesn’t add real value, why do it?)*
  2. WE DESIGN USEFUL THINGS. Value comes from products that are purposeful. Our commitment is to design products that have a meaningful impact on people’s lives; IoT technologies are merely tools to enable that.
    (Comment: see number 1!)
  3. “WE AIM FOR THE WIN-WIN-WIN. A complex web of stakeholders is forming around IoT products: from users, to businesses, and everyone in between. We design so that there is a win for everybody in this elaborate exchange.
    (Comment:This is a big one in my mind, and relates to my IoT Essential Truth #2 — share data, don’t hoard it — when you share IoT data, even with competitors in some cases [think of IFTTT “recipes”] — you can create services that benefit customers, companies, and even the greater good, such as reducing global warming).
  4. WE KEEP EVERYONE AND EVERYTHING SECURE. With connectivity comes the potential for external security threats executed through the product itself, which comes with serious consequences. We are committed to protecting our users from these dangers, whatever they may be.
    (Comment: Amen! as I’ve written ad nauseum, protecting privacy and security must be THE highest IoT priority — see next post below!).
  5. WE BUILD AND PROMOTE A CULTURE OF PRIVACY. Equally severe threats can also come from within. Trust is violated when personal  information gathered by the product is handled carelessly. We build and promote a culture of integrity where the norm is to handle data with care.
    (Comment:See 4!).
  6. WE ARE DELIBERATE ABOUT WHAT DATA WE COLLECT. This is not the business of hoarding data; we only collect data that serves the utility of the product and service. Therefore, identifying what those data points are must be conscientious and deliberate.
    (Comment: this is a delicate issue, because you may find data that wasn’t originally valuable becomes so as new correlations and links are established. However, just collecting data willy-nilly and depositing it in an unstructured “data lake” for possible use later is asking for trouble if your security is breeched.).
  7. WE MAKE THE PARTIES ASSOCIATED WITH AN IOT PRODUCT EXPLICIT. IoT products are uniquely connected, making the flow of information among stakeholders open and fluid. This results in a complex, ambiguous, and invisible network. Our responsibility is to make the dynamics among those parties more visible and understandable to everyone.
    (Comment: see what I wrote in the last post, where I recommended companies spell out their privacy and usage policies in plain language and completely).
  8. WE EMPOWER USERS TO BE THE MASTERS OF THEIR OWN DOMAIN. Users often do not have control over their role within the network of stakeholders surrounding an IoT product. We believe that users should be empowered to set the boundaries of how their data is accessed and how they are engaged with via the product.
    (Comment: consistent with prior points, make sure that any permissions are explicit and  opt-in rather than opt-out to protect users — and yourself (rather avoid lawsuits? Thought so…)
  9. WE DESIGN THINGS FOR THEIR LIFETIME. Currently physical products and digital services tend to be built to have different lifespans. In an IoT product features are codependent, so lifespans need to be aligned. We design products and their services to be bound as a single, durable entity.
    (Comment: consistent with the emerging circular economy concept, this can be a win-win-win for you, your customer and the environment. Products that don’t become obsolete quickly but can be upgraded either by hardware or software will delight customers and build their loyalty [remember that if you continue to meet their needs and desires, there’s less incentive for customers to check out competitors and possibly be wooed away!). Products that you enhance over time and particularly those you market as services instead of sell will also stay out of landfills and reduce your pduction costs.
  10. IN THE END, WE ARE HUMAN BEINGS. Design is an impactful act. With our work, we have the power to affect relationships between people and technology, as well as among people.  We don’t use this influence to only make profits or create robot overlords; instead, it is our responsibility to use design to help people, communities, and societies  thrive.
    Comment: yea designers!!)

I’ve personally signed onto the Manifesto, and do hope to contribute in the future (would like something explicit about the environment in it, but who knows) and urge you to do the same. More important, why start from scratch to come up with your own product design guidelines, when you can capitalize on the hard work that’s gone into the Manifesto as a starting point and modify it for your own unique needs?


*BTW: I was contemptuous of the first IoT electric toothbrush I wrote about, but since talked to a leader in the field who convinced me that it could actually revolutionize the practice of dentistry for the better by providing objective proof that  patient had brushed frequently and correctly. My bad!

comments: Comments Off on IoT Design Manifesto 1.0: great starting point for your IoT strategy & products! tags: , , , , ,

“The House That Spied on Me”: Finally Objective Info on IoT Privacy (or Lack Thereof)

Posted on 25th February 2018 in data, Essential Truths, Internet of Things, privacy, security, smart home

Pardon a political analogy, Just as the recent indictment of 13 Russians in the horrific bot campaign to undermine our democracy (you may surmise my position on this! The WIRED article about it is a must read!) finally provided objective information on the plot, so too Kasmir Hill’s and Surya Matu’s excruciatingly detailed “The House That Spied on Me”  finally provides objective information on the critical question of how much personal data IoT device manufacturers are actually compiling from our smart home devices.

This is critical, because we’ve previously had to rely on anecdotal evidence such as the Houston baby-cam scandal, and that’s not adequate for sound government policy making and/or advice to other companies on how to handle the privacy/security issue.

Last year, Hill (who wrote one of the first articles on the danger when she was at Forbes) added just about every smart home you can imagine to her apartment (I won’t repeat the list: I blush easily…) . Then her colleague, Matu, monitored the outflow of the devices using a special router he created to which she connected all the devices:

“… I am basically Kashmir’s sentient home. Kashmir wanted to know what it would be like to live in a smart home and I wanted to find out what the digital emissions from that home would reveal about her. Cybersecurity wasn’t my focus. … Privacy was. What could I tell about the patterns of her and her family’s life by passively gathering the data trails from her belongings? How often were the devices talking? Could I tell what the people inside were doing on an hourly basis based on what I saw?”

The answer was: a lot (I couldn’t paste the chart recording the numbers here, so check the article for the full report)!

As Matu pointed out, with the device he had access to precisely the data about Hill’s apartment that Comcast could collect and sell because of a 2017 law allowing ISPs to sell customers’ internet usage data without their consent — including the smart device data.  The various devices sent data constantly — sometimes even when they weren’t being used! In fact, there hasn’t been a single hour since the router was installed in December when at least some devices haven’t sent data — even if no one was at home!

BTW: Hill, despite her expertise and manufacturers’ claims of ease-of-setup, found configuring all of the devices, and especially making them work together, was a nightmare. Among other tidbits about how difficult it was: she had to download 14 different apps!  The system also directly violated her privacy, uploading a video of her walking around the apartment nude that was recorded by the Withings Home Wi-Fi Security (ahem…) Camera with Air Quality Sensors. Fortunately the offending video was encrypted. Small comfort.

Hill came to realize how convoluted privacy and security can become with a smart home:

“The whole episode reinforced something that was already bothering me: Getting a smart home means that everyone who lives or comes inside it is part of your personal panopticon, something which may not be obvious to them because they don’t expect everyday objects to have spying abilities. One of the gadgets—the Eight Sleep Tracker—seemed aware of this, and as a privacy-protective gesture, required the email address of the person I sleep with to request his permission to show me sleep reports from his side of the bed. But it’s weird to tell a gadget who you are having sex with as a way to protect privacy, especially when that gadget is monitoring the noise levels in your bedroom.”

Matu reminds us that, even though most of the data was encrypted, even the most basic digital exhaust can give trained experts valuable clues that may build digital profiles of us, whether to attract us to ads or for more nefarious purposes:

“It turns out that how we interact with our computers and smartphones is very valuable information, both to intelligence agencies and the advertising industry. What websites do I visit? How long do I actually spend reading an article? How long do I spend on Instagram? What do I use maps for? The data packets that help answer these questions are the basic unit of the data economy, and many more of them will be sent by people living in a smart home.”

Given the concerns about whether Amazon, Google, and Apple are constantly monitoring you through your smart speaker (remember when an Echo was subpoenaed  in a murder case?), Matu reported that:

“… the Echo and Echo Dot … were in constant communication with Amazon’s servers, sending a request every couple of minutes to http://spectrum.s3.amazonaws.com/kindle-wifi/wifistub-echo.html. Even without the “Alexa” wake word, and even when the microphone is turned off, the Echo is frequently checking in with Amazon, confirming it is online and looking for updates. Amazon did not respond to an inquiry about why the Echo talks to Amazon’s servers so much more frequently than other connected devices.”

Even the seemingly most insignificant data can be important:

“I was able to pick up a bunch of insights into the Hill household—what time they wake up, when they turn their lights on and off, when their child wakes up and falls asleep—but the weirdest one for me personally was knowing when Kashmir brushes her teeth. Her Philips Sonicare Connected toothbrush notifies the app when it’s being used, sending a distinctive digital fingerprint to the router. While not necessarily the most sensitive information, it made me imagine the next iteration of insurance incentives: Use a smart toothbrush and get dental insurance at a discount!”

Lest you laugh at that, a dean at the BU Dental School told me much the same thing: that the digital evidence from a Colgate smart brush, in this case, could actually revolutionize dentistry, not only letting your dentist how well, or not, you brushed, but perhaps lowering your dental insurance premium or affecting the amount your dentist was reimbursed. Who woulda thunk it?

Summing up (there’s a lot of additional important info in the story, especially about the perfidious Visio Smart TV, that had such a company-weighted privacy policy that the FTC actually forced it to turn it off the “feature” and pay reparations, so do read the whole article), Hill concluded:

“I thought the house would take care of me but instead everything in it now had the power to ask me to do things. Ultimately, I’m not going to warn you against making everything in your home smart because of the privacy risks, although there are quite a few. I’m going to warn you against a smart home because living in it is annoying as hell.”

In addition to making privacy and security a priority, there is another simple and essential step smart home (and Quantified Self) device companies must take.

When you open the box for the first time, the first thing you should see must be a prominently displayed privacy and security policy, written in plain (and I mean really plain) English, and printed in large, bold type. It should make it clear that any data sharing is opt-in, and that you have the right to not agree, and emphasize the need for detailed, unique passwords (no,1-2-3-4 or the ever-popular “password” are not enough.

Just to make certain the point is made, it needs to be at the very beginning of the set-up app as well. Yes, you should also include the detailed legalese in agate type, but the critical points must be made in the basic statement, which needs to be reviewed not just by the lawyers, but also a panel of laypeople, who must also carry out the steps to make sure they’re really easily understood and acted on. This is not just a suggestion. You absolutely must do it or you risk major penalties and public fury. 


Clearly, this article gives us the first objective evidence that there’s a lot more to do to assure privacy and security for smart homes (and that there’s also a heck of a lot of room for improvement on how the devices play together!), reaffirming my judgement that the first IoT Essential Truth remains “make privacy and security your highest priority.” If this doesn’t get the focus it deserves, we may lose all the benefits of the IoT because of legitimate public and corporate concern that their secrets are at risk. N.B.!

comments: Comments Off on “The House That Spied on Me”: Finally Objective Info on IoT Privacy (or Lack Thereof) tags: , , , , ,

Apple Watch 85% Accuracy in Detecting Diabetes May Be Precursor of Early Diagnoses

Permit me to (re-)introduce myself, LOL.

I haven’t posted since the end of October, because I was totally absorbed in writing The Future is Smart, my book about IoT strategy, which will be released in August by AMACOM, the publishing wing of the American Management Association. A major theme of the book is that the IoT lifts what I term the condition of  “Collective Blindness” that used to plague us before the advent of real-time data from sensors and the analytical software to interpret that data. Collective Blindness meant that we were frequently operating in figurative darkness, having to guess about how things worked or didn’t without direct observational data, which meant that we frequently didn’t learn about problems inside things until after the fact, which could mean costly (and sometimes fatal) corrective maintenance was all that was possible.

Those “things” unfortunately included the human body.

Usually the only way to uncover a problem inside our bodies pre-IoT was through costly pre-arranged tests at the doctor’s or a hospital. They could only provide a snapshot in time, documenting your body’s state at that precise moment (when, after all, you might be flat on your back wearing a johnny — not exactly representative of your actual condition as you go about your daily routine!). If you had no complaint warranting such a test, the condition might go undiagnosed until it was significantly worse (remember the contrast between prompt predictive maintenance of a jet turbine and costly emergency repairs when a disaster loomed?).

That’s why the news from Brandon Ballinger, the Google alum who was co-founder of the Cardiogram app (get it! I did! and I joined their Artificial Intelligence-driven Health eHeart Study as well!) is so important. In a clinical study released last week, the research team found that the Apple Watch is 85% accurate in detecting diabetes in those previously diagnosed with the disease. The paper was presented at the AAAI Conference on Artificial Intelligence last week in New Orleans.

Results from heart monitoring with Apple Watch and Cardiogram app

The study analyzed data from 14,000 Apple Watch users, finding that 462 participants through the heart rate sensor, the same type of sensor.

The investigation tested a 2015 finding by our famous local Framingham Heart Study that resting heart rate and heart rate variability significantly predicted incident diabetes and hypertension.

According to TechCrunch,  Ballinger’s team had previously used the Watch “to detect an abnormal heart rhythm with up to a 97 percent accuracy, sleep apnea with a 90 percent accuracy and hypertension with an 82 percent accuracy when paired with Cardiogram’s AI-based algorithm.”

This is important for several reasons.

We’ve read for several years about single-purpose devices that might be able to diagnose diabetes and determine the need for insulin without painful pinpricks, but the Cardiograph research might show that simply harvesting enough data with a multi-purpose fitness device such as the Watch and being able to interpret it creatively with Artificial Intelligence would be enough. That’s the logical next step with the Health eHeart Study.

It reminds me of the example I’ve mentioned several times before of neonatologists from Toronto’s Hospital for Sick Children and IBM data scientists combining to analyze the huge amount of sensor data harvested from preemies’ bassinettes and being able to diagnose a potentially-lethal neonatal sepsis infection a full day before any visible sign of the infection.

Given these two examples, one must ask, how many other health problems might be diagnosed in their earliest stages, which cures are most likely and least expensive, if routine monitoring through devices such as the Apple Watch become commonplace and the results are crunched with AI? In particular, this could be a key part of my SmartAging concept.

Exciting!

 

NB: I work part-time for The Apple Store, but am not privy to any strategy or inside information. These opinions are purely my own as an Apple Watch user.

 

comments: Comments Off on Apple Watch 85% Accuracy in Detecting Diabetes May Be Precursor of Early Diagnoses tags: , , , , , , , ,
http://www.stephensonstrategies.com/">Stephenson blogs on Internet of Things Internet of Things strategy, breakthroughs and management