Here’s how to spot legitimate AI from marketing fluff

Within the Data Science community, there’s a joke that goes like this:

There are a lot of companies out there that claim to do artificial intelligence (AI). You’ll find the omnipresent initials appended to domain names or within the first few words of a pitch deck, but, frankly, a lot of it is BS. Usually, it’s a set of simple regressions and/or heuristics that require a human monitor, making it more of a semi-automation system. A true, robust AI system enables in-the-moment decision-making with the influx of new data — all without human oversight (*someinitialassembly required). More often than not, many solutions are labeled “AI” simply because it excites executives and VCs. 

Despite the noise that crowds the market, there are, in fact, companies that offer true AI solutions. Take one of the many major autonomous vehicle companies that are dealing with very tight control tolerances: the risk of inaccuracy could mean a major accident. 

So, if the legitimate AI companies are mixed in with vaporware like puffed cheese snacks in party mix, how can you identify the good ones?

When PE or VC firms evaluate startups, it’s not entirely the idea or product that determines an investment decision. A major factor is the executive team — how well they work together, and how their backgrounds prepare them for success. When evaluating an AI/machine learning product, adopt the same process. 

Consider the backgrounds and expertise of the key contributors to the product. A majority of their backgrounds should fall within a technical domain: Computer Science, Mathematics, Engineering, etc. Another plus: team members with experience in your vertical, which can shape how a solution is deployed and ensure it’s a good fit for your company and processes.

More often than not, companies with vaporware have not done their technical homework. If the AI product is totally bogus, you can often sniff that out with some basic questions that true AI experts can answer. If needed, bring someone with a machine learning and statistics background to spot BS. 

I once spoke to a company selling AI for predictive automobile maintenance. A colleague of mine asked how many hidden layers were in their neural network, to which the startup responded “11,000.” 

This answer provoked 15 more minutes of awkward conversation and backtracking, because that figure is roughly 500x more hidden layers than the best pre-trained neural networks geared towards object recognition. This one simple question flagged many alarms for our team and needless to say, we ended our discussions. 

You should ask questions like:

If you’re evaluating a product for your business, it’s not enough to ask someone with a technical background to weigh in on the validity of an AI claim. There should be a team with experience in project management, technical product deployment and/or change management to gauge an AI product’s ability to adapt to your existing systems, processes, and even cultural norms. 

Other areas of technical/managerial expertise may be needed depending on the problem you are hoping to solve with a particular AI product. For instance, if you’re a manufacturing company looking to integrate AI into your quality control processes, you should also involve Manufacturing and Quality engineers to examine and validate the predicted responses.

The next time you see “AI” on anything (which is inevitable these days), be skeptical by default. There are companies who are truly doing amazing work in this field, but do your homework. The above isn’t a complete checklist, but a good starting point to help you avoid buying into snake oil and creating a big mess at your company.

Source: The Next Web

Powered by NewsAPI.org

Keywords:

Artificial intelligence • Data science • Artificial intelligence • Artificial intelligence • Domain name • Sales presentation • Set (mathematics) • Regression analysis • Heuristic • Automation • Truth • Robust statistics • Artificial intelligence • Decision-making • Data • Regulation • Artificial intelligence • Venture capital • Market (economics) • Artificial intelligence • Vehicular automation • Artificial intelligence • Vaporware • Cheese • Venture capital • Idea • Product (business) • Senior management • Cooperation • Goal • Artificial intelligence • Machine learning • Product (business) • Business process • Multiplication • Technology • Computer science • Mathematics • Engineering • Goods • Company • Systems engineering • Company • Vaporware • Technology • Artificial intelligence • Product (business) • Artificial intelligence • Machine learning • Statistics • Tokyo Broadcasting System • Artificial intelligence • Service (motor vehicle) • Artificial neural network • Backtracking • Artificial neural network • Outline of object recognition • Artificial intelligence • User experience • Project management • Technology • Product (business) • Software deployment • Change management • Artificial intelligence • Product (business) • System • Business process • Norm (social) • Technology • Management • Expert • Problem solving • Artificial intelligence • Product (business) • Manufacturing • Artificial intelligence • Quality control • Business process • Military engineering • Prediction • Artificial intelligence • Snake oil •