|
METRICS
So after all the classes, online training and tips, how does a security professional know whether the effort is paying off? Measuring the effectiveness of awareness training can be tough. How do you measure something that hasn't happened, like a breach?
Many, like Pizzini, rely on informal feedback from employees. Drain says he gauges whether he's getting through to employees based on the questions they ask him. Some use surveys and others test their employees' security awareness via social engineering/ penetration tests.
USA Federal Credit Union has performed social engineering tests the past two years. Last year, an auditor pretending to be a contractor got into a branch break room before employees questioned him. This year, he didn't make it past the lobby at two different branches. Also, phishing emails used as part of the test failed to fool any employees this year, a huge improvement over the 60 percent that fell for them last year.
"I was walking around like a proud mother," says Carolyn James, senior vice president and CIO at USA Federal. "It's just obvious that continual awareness training helps."
James says it's important to remind employees about security without nagging them and to make it fun. Her awareness program involves presentations to new employees and computer-based training that all of the credit union's 220 employees must take annually. She regularly sends emails or posts items on the company intranet, and sometimes includes funny pictures to catch users' attention. She's also given out stress balls in the shape of a key and printed with the slogan, "You are the key to security."
Some argue that employees will take training seriously if they know there are consequences for security miscues--reprimands or even termination. But many, like James, try to avoid scare tactics. In staff meetings and company-wide emails, she praises employees who send her phishing emails they receive or notify her of other suspicious activity.
The positive reinforcement pays off: "People email me on a regular basis when they find something that looks suspicious," James says. "It's almost like I have my own posse."
Publishing a list of employees whose passwords successfully passed an auditor's strength test sparked some healthy competition between employees, who eagerly called her to find out how their passwords fared. "They were shocked that a password they considered secure was cracked in 15 seconds," James says.
Care New England also tests whether employees are taking security lessons to heart. It uses software from Core Security Technologies to send out emails that measure how employees respond to phishing and other email threats. "If they click on a link, you remind them of the training and they say, 'Oh, I get it now'," Pesce says.
Some security experts debunk training as useless. For instance, Marcus Ranum wrote that user education was one of the six dumbest ideas in computer security. If it was going to work, it would have worked by now, he argues. And some security specialists, Pesce says, argue that it's better just to lock down everything instead of relying on humans to do the right thing--a notion with which he partially disagrees.
"We can only do so much to secure the systems, manage risk and still have them usable," he says "Even if we only catch 50 percent of our users with this [training], that's still 50 percent we wouldn't have if we hadn't done it."
Pizzini, meanwhile, is always on the lookout for new magic tricks to add to her lessons.
Security awareness training is critical to an overall information security program, she says: "The more education you provide, the better off you are."
|