Skip to main content
Sister Publication Links
  • Automotive News
  • Automotive News Europe
  • Automotive News China
  • Automobilwoche
Subscribe
  • Subscribe
  • login
  • HOME
  • News
    • News by Brand
    • Auto Shows
    • Canadians Abroad
    • Photo Galleries
    • Automakers
    • Suppliers
    • Retail
    • Dealer Best Practices
    • Government Relations
    • Trade and Tariffs
    • Technology
    • Labour
    • Aston Martin
    • BMW
      • Mini
      • Rolls Royce
    • Daimler
      • Mercedes Benz
      • Smart
    • Ferrari
    • Ford
      • Lincoln
    • General Motors
      • Buick
      • Cadillac
      • Chevrolet
      • GMC
    • Honda
      • Acura
    • Hyundai
      • Kia
    • Mazda
    • Mitsubishi
    • Nissan
      • Infiniti
    • Stellantis
      • Alfa Romeo
      • Chrysler
      • Dodge
      • Fiat Chrysler
      • Jeep
      • Fiat
      • Lancia
      • Maserati
      • Ram
    • Subaru
    • Tata
      • Jaguar
      • Land Rover
    • Tesla
    • Toyota
      • Lexus
    • Volkswagen
      • Audi
      • Bentley
      • Bugatti
      • Lamborghini
      • Porsche
    • Volvo
    • VinFast
    • Toronto Auto Show
  • Opinion
    • Blogs
  • Video
  • Podcasts
  • EVENTS & AWARDS
    • 2021 Auto News Canada All Stars
    • 2021 Canadians To Watch
    • Best Dealerships To Work For
    • Canada Congress
    • Retail Forum: Dealer Discussions
    • Leading Women Roundtables
    • Embracing Diversity Roundtable
  • Jobs & Classifieds
  • +MORE
    • IN THE DRIVER'S SEAT
    • NEWSLETTERS
    • SUBSCRIBE
    • CLASSIFIEDS
    • PEOPLE ON THE MOVE
    • COMPANIES ON THE MOVE
    • WEBINARS
    • ADVERTISE WITH US
    • CONTACT US
    • DIGITAL EDITION
    • PUBLISHING PARTNERS
MENU
Breadcrumb
  1. Home
  2. Retail
August 26, 2019 12:00 AM

Lessons learned from the computer glitch that crashed Nissan

Urvaksh Karkaria
  • Tweet
  • Share
  • Share
  • Email
  • More
    Print
    1SMYRNA-MAIN_i.jpg
    The data center crash stopped Nissan production in Smyrna, Tenn.

    A critical Nissan Group data center in Denver crashed Aug. 17 apparently because of a power outage. The results were widespread and frustrating for the automaker and its retailers last week, sending customers away empty-handed and interrupting factory production — as Nissan Group is doggedly trying to shore up falling U.S. retail sales.

    But the crisis also demonstrates a larger vulnerability for today's auto industry, which depends on complex digital vehicle distribution systems that link data and commerce among consumers, retailers, distribution networks, manufacturing plants and finance companies.

    All of that shut down for Nissan Group last week, affecting the operations of Nissan and Infiniti's approximately 1,300 U.S. dealers as well as an undetermined number of retailers in Canada and Mexico.

    A Nissan Canada spokesman wasn't specific in saying how the outage affected Canadian operations, just that it did.

    It was unclear at week's end how many new-vehicle sales Nissan Group lost from the glitch or what the ultimate cost will be to dealers, sales personnel and service shops.

    The system, referred to internally as NNANet, is the retailer's tool for ordering cars and parts, obtaining product rebate information to know how to structure a sale, checking on vehicle recalls, filing warranty claims to enable service work to be performed and priced, and seeking factory financing information.

    "Everything we do with Nissan goes through NNANet," said Tim Hill, owner of Hill Nissan in Winter Haven, Fla. "That is our lifeblood."

    The system remained down for four days, grounding operations at many retailers. Service was restored by 6 p.m. Central Daylight Time on Wednesday, Aug. 21.

    FACTORY PRODUCTION

    The data crash also brought down production at Nissan's factories in Smyrna, Tenn., and Canton, Miss., according to the company.

    Nissan spokesman Chris Keeffe did not estimate lost sales or production. Nissan also declined to elaborate on how a power outage at a data center could take down such a mission-critical network and disable the company for several days.

    Dealers were surprised the shutdown was so widespread and lengthy. Some told Automotive News they suspected the automaker's linchpin information technology system had been the target of a cyberattack. Keeffe said it was not a cyberattack.

    "Our data center in Denver experienced a power failure, disabling our backup systems and prolonging the systems outage," Keeffe said.

    He did not say why the power outage also took down the backup systems nor provide details about Nissan's business recovery plan.

    Extreme heat in Colorado led to the outages in the Denver area.

    Nissan's lengthy recovery period is instructive for automakers.

    Businesses should have backups of their data, applications and systems in different places across the country, said Armistead Whitney, CEO of Apptega, an Atlanta company that helps companies manage IT risks.

    "That way, when one facility, area or region experiences a major disruption, the chances are extremely low that another geography is impacted, resulting in the disruption only lasting minutes or a couple of hours instead of days," Whitney said.

    The consultant advises against co-locating communication systems such as phones and email with core business applications.

    "When a major business system goes down, it also brings down the communications system, which compounds the outrage of the outage by not being able to provide timely updates to colleagues and customers."

    Nissan's disruption should have been anticipated, said Ray Brandt, CEO of Ray Brandt Automotive Group in suburban New Orleans.

    "We were surprised that it happened without a real backup plan to make sure that if it did happen, we could minimize the pain," Brandt said. "I'm surprised it took four days to get it resolved."

    During the NNANet shutdown, Nissan and Infiniti stores were unable to order new vehicles from Nissan, report vehicles that have been sold, place online part orders or process warranty claims.

    Customers complained on social media about being unable to get recall information, having service appointments rescheduled and, for one customer, being unable to have an ignition key reprogrammed.

    'CRUNCH TIME'

    The service disruption occurred at a particularly bad time: Dealers typically book most of their sales toward the end of the month.

    "This is the crunch time of our month," Brandt said. "We've got to make big sales. We have big objectives and money on the table. We were penalized. There's no doubt about it."

    Brandt anticipates the outage cost his dealership about 10 percent of its sales for the month as customers had to be turned away because the store could not access financial information from Nissan and its finance arm. "It's a very impatient world," Brandt said.

    Nissan said it expects the service outage to dampen August sales.

    The company told retailers late last week it will trim August dealer sales goals 10 percent "to reflect the business disruption caused by the Nissan computer network system outage over the past few days."

    One New Jersey dealer said the service disruption affected "literally every aspect of the business."

    During the outage, the dealership focused on selling used cars and got parts from other dealers.

    The disruption also affected Nissan's financial arm, Nissan Motor Acceptance Corp. That meant dealers could not check customer payoff information and customers could not make monthly car payments.

    The New Jersey dealer said, "I had a gentleman come in and we couldn't get his payoffs, so we had to turn him away."

    RECOMMENDED FOR YOU
    VW to launch ‘satellites’ into Canada’s retail space
    Recommended for You
    VW Satellite Store Concept
    VW to launch ‘satellites’ into Canada’s retail space
    Polestar Montreal Shipping Container Showroom
    Polestar Canada plans new showrooms, leaving shipping containers, malls behind
    2022_jeep_compass_1.jpg
    Jeep making inroads on both ends of lineup
    Luciano Butera
    Sponsored Content: Expert insights | The used-car inventory crunch
    Digital Edition
    May 2022 Cover
    View latest issue
    See our archive
    Sign up for free newsletters
    EMAIL ADDRESS

    Please enter a valid email address.

    Please enter your email address.

    Please verify captcha.

    Please select at least one newsletter to subscribe.

    You can unsubscribe at any time through links in these emails. For more information, see our Privacy Policy.

    Get Free Newsletters

    Sign up today for our Weekly Newsletter, Daily Newsletter and Breaking News Alerts. We'll deliver the news you need to know straight to your inbox.

    You can unsubscribe at any time through links in these emails. For more information, see our Privacy Policy.

    Subscribe Now

    An Automotive News Canada subscription includes 12 monthly issues – delivered in print to your doorstep, and digitally to your inbox – plus unlimited, 24/7 access to our website.

    Subscribe Now
    Connect With Us
    • Facebook
    • Twitter
    • Instagram

    Our Mission

    The Automotive News Canada mission is to be the primary source of industry news, data and understanding for the industry's decision-makers interested in Canada.

    Contact Us

    1155 Gratiot Ave
    Detroit MI 48207

    1-877-812-1257

    Email Us

    ISSN 2475-5001 (print)
    ISSN 2475-501X (online)

    Resources
    • About us
    • Contact Us
    • Digital Edition Archive
    • Advertise with Us
    • Reprints
    • Ad Choices Ad Choices
    • Sitemap
    Legal
    • Terms and Conditions
    • Privacy Policy
    • Privacy Request
    Automotive News Canada
    Copyright © 1996-2022. Crain Communications, Inc. All Rights Reserved.
    • HOME
    • News
      • News by Brand
        • Aston Martin
        • BMW
          • Mini
          • Rolls Royce
        • Daimler
          • Mercedes Benz
          • Smart
        • Ferrari
        • Ford
          • Lincoln
        • General Motors
          • Buick
          • Cadillac
          • Chevrolet
          • GMC
        • Honda
          • Acura
        • Hyundai
          • Kia
        • Mazda
        • Mitsubishi
        • Nissan
          • Infiniti
        • Stellantis
          • Alfa Romeo
          • Chrysler
          • Dodge
          • Fiat Chrysler
          • Jeep
          • Fiat
          • Lancia
          • Maserati
          • Ram
        • Subaru
        • Tata
          • Jaguar
          • Land Rover
        • Tesla
        • Toyota
          • Lexus
        • Volkswagen
          • Audi
          • Bentley
          • Bugatti
          • Lamborghini
          • Porsche
        • Volvo
        • VinFast
      • Auto Shows
        • Toronto Auto Show
      • Canadians Abroad
      • Photo Galleries
      • Automakers
      • Suppliers
      • Retail
      • Dealer Best Practices
      • Government Relations
      • Trade and Tariffs
      • Technology
      • Labour
    • Opinion
      • Blogs
    • Video
    • Podcasts
    • EVENTS & AWARDS
      • 2021 Auto News Canada All Stars
      • 2021 Canadians To Watch
      • Best Dealerships To Work For
      • Canada Congress
      • Retail Forum: Dealer Discussions
      • Leading Women Roundtables
      • Embracing Diversity Roundtable
    • Jobs & Classifieds
    • +MORE
      • IN THE DRIVER'S SEAT
      • NEWSLETTERS
      • SUBSCRIBE
      • CLASSIFIEDS
      • PEOPLE ON THE MOVE
      • COMPANIES ON THE MOVE
      • WEBINARS
      • ADVERTISE WITH US
      • CONTACT US
      • DIGITAL EDITION
      • PUBLISHING PARTNERS