Home
>
Spam Blocking
>
Spam Filters Explained

town car ride to ohare Marengo Park Ridge taxi to Midway Naperville south of 95 limo Midway Lincoln Stretch limo rentals Deerfield travel from O'Hare Carpentersville .. Drug testing

Spam Filters Explained

What do they do? How do they work? Which one is right for me? By Alan Hearnshaw

Spam is a very real problem that many people have to deal with on a daily basis. For those that have decided to do something about it and start to investigate the options available in spam filtering, this article provides a brief introduction to your options and the types of spam filters available.

Despite the bewildering array of spam filters available today, all claiming to the best one "of its kind" there are really just five filtering methodologies in general use today and all products rely on one, or a combination of these:

Content-Based Filters

"In the beginning, there were content-based filters."

These filters scan the contents of the and look for tell-tale signs that the message is spam. In the early days of spamming it was quite simple to look out for "Kill Words" such as "Lose Weight" and mark a message as spam if it was found.

Very soon though, spammers got wise to this and started resorting to all kinds of tricks to get their message past the filters. The days of "obfuscation" had begun. We started getting messages containing the phrase "L0se Welght" (Notice the zero for "o" and "l" for "i") and even more bizarre ? and sometimes quite ingenious ? variations.

This rendered basic content-based filters somewhat ineffective, although there are one or two on the market now that are clever enough to "see through" theses attempts and still provide good results.

Bayesian Based Filters

"The Reverend Bayes comes to the rescue"

Born in London 1702, the son of a minister, Thomas Bayes developed a formula which allowed him to determine the probability of an event occurring based on the probabilities of two or more independent evidentiary events.

Bayesian filters "learn" from studying known good and bad messages. Each message is split into single "word bytes", or tokens and these tokens are placed into a database along with how often they are found in each kind of message.

When a new message arrives to be tested by the filter, the new message is also split into tokens and each token is looked up in the database. Extrapolating results from the database and applying a form of the good reverend's formula, know as the a "Naive Bayesian" formula, the message is given a "spamicity" rating and can be dealt with accordingly.

Bayesian filters typically are capable of achieving very good accuracy rates (>97% is not uncommon), and require very little on-going maintenance.

Whitelist/Blacklist Filters

"Who goes there, friend or foe?"

This very basic form of filtering is seldom used on its own nowadays, but can be useful as part of a larger filtering strategy.

A "whitelist" is nothing more than a list of e-mail addresses from which you wish to accept communications. A whitelist filter would only accept messages from these people and all others would be rejected

A "blacklist", conversely, is a list of e-mail addresses - and sometimes IP Addresses (computer identification addresses) - from which communications will not be accepted.

While this may seem like a good idea from the outset, a whitelist methodology is too restrictive for most people and, as virtually all spam e-mails carry a forged "from" address, there is little point in collecting this address to ban it in future as it is very unlikely to be the same next time.

There are bodies on the internet that maintain a list of known "bad" sources of e-mail. Many filters today have the ability to query these servers to see if the message they are looking at comes from a source identified by this Internet-based blacklist, or RBL. While being quite effective, they do tend to suffer from "false positives" where good messages are incorrectly identified as spam. This happens often with newsletters.

Challenge/Response Filters

"Open sesame!"

Challenge/Response filters are characterised by their ability to automatically send a response to a previously unknown sender asking them to take some further action before their message will be delivered. This is often referred to as a "Turing Test" - named after a test devised by British mathematician Alan Turing to determine if machines could "think".

Recent years have seen the appearance of some internet services which automatically perform this Challenge/Response function for the user and require the sender of an e-mail to visit their web site to facilitate the receipt of their message.

Critics of this system claim it to be too drastic a measure and that it sends a message that "my time is more important than yours" to the people trying to communicate with you.

For some low traffic e-mail users though, this system alone may be a perfectly acceptable method of completely eliminating spam from their inbox - one step above the "Whitelist" system outlined above.

Community Filters

"A united front"

These types of filters work on the principal of "communal knowledge" of spam. When a user receives a spam message, they simply mark it as such in their filter. This information is sent to a central server where a "fingerprint" of the message is stored.

After enough people have "voted" this message to be spam, then it is stopped from reaching all the other people in the community.

This type of filtering can prove to be quite effective, although it stands to reason that it can never be 100% effective as a few people have to receive the spam for it to be "flagged" in the first place. Just like its similar cousin the Internet black list (RBL), this system also can suffer from "false positives", or messages incorrectly identified as spam.

Hopefully you are now armed with a little more information to be able to make an informed decision on the best spam filter for you.

For further information, consider reading the reviews and articles found at http://www.whichspamfilter.com

Alan Hearnshaw is a computer programmer and the owner of http://www.whichspamfilter.com, a web site which conducts weekly in-depth reviews of current spam filters, provides help and guidance in the fight against spam and provides a useful community forum. alan@whichspamfilter.com

limousine chicago service

In The News:

Now that Google has gotten permission from China's Anti-Monopoly Bureau to acquire Motorola Mobility, the companies are expected to complete their merger by the middle of this week.

IT management executives from large corporations worry most about how to manage employee-owned devices safely and securely, according to clients of the Directions on Microsoft analyst firm.

Silver Peak today upgraded the software for its WAN appliance to handle automated optimization for TCP and non-TCP traffic, 512,000 simultaneous connections for 10 gigabit-per-second (Gbps) infrastructures and support for a bunch of common hypervisors.

IT managers grappling with bring-your-own-device policies can expect to see an explosion in the number of smartphones and tablets used by employees.

The big cable companies know that if they want to stay relevant in the wireless market, they can't do it on their own.

Version 3.4 of the Linux kernel was officially rolled out Sunday, in what maintainer Linus Torvalds called a "calm" release cycle.

Google has "a matter of weeks" to address four antitrust issues identified by European Union antitrust regulators. If Google addresses these issues the case can be solved by a so-called "commitment decision" instead of formal antitrust proceedings resulting in a fine, said JoaquAn Almunia, Vice President of the European Commission responsible for Competition Policy.

Yahoo has agreed to sell off about half of its stake in Alibaba Group back to the Chinese e-commerce giant as part of a US$7.1 billion deal, the two companies jointly announced on Monday.

If the numbers at StatCounter are accurate then the world has a new Web browser champion: Google Chrome.

The chief of AT&T Mobility can't wait for Windows 8 tablets to hit the market because they'll fuel demand for Windows phones.

IBM is offering employees who are nearing retirement a one-time opportunity to take advantage of a program that would guarantee their employment through Dec. 31, 2013.

Europe's top court has ruled that the functionality of a computer program and the programming language it is written in cannot be protected by copyright.

Your boss wants it yesterday, but it better be good when judged by the standards of tomorrow. Your customers want every feature they can imagine, but don't you dare confuse them by giving them all the buttons they want. Your fellow programmers want your code documented, but they just respond "tl;dr" to anything you write.

After all the attention, clamor, and expectations Facebook is now a publicly traded company worth $104 billion. With shares trading at a hundred times earnings, Facebook is under a lot of pressure to increase the profit that it brings in. In other words, now the fun begins.

Microsoft is abandoning the 'Aero' user interface with Windows 8, calling the UI that debuted in Vista and continued in Windows 7, 'cheesy' and 'dated.'

Company claims system requirements will be the same as those of Visual Studio 2010 despite performance increases

The NFL has big stadiums, big players and big games, but when it comes to computer systems, the league's vice president of IT doesn't use the word big.

Despite interoperability trials and demonstrations involving alternative data center fabric standards, a non-standard fabric technology is said by proponents to be at the front of the pack.

Taiwanese smartphone vendor High Tech Computer said on Sunday certain models of its newest smartphones have passed U.S. Customs and are being released to its carrier customers, after the company previously warned of a delay in product shipments because of an International Trade Commission (ITC) order.

So.cl, an experimental research project from Microsoft, that combines social networking and search to promote learning, is now accepting all users interested in joining the site.

Email managers have a lot at stake. After all, the volume of global electronic messages sent via email dwarfs all other forms of electronic communication, including social networking. Since the inception of electronic mail, which, according to some Internet historians, can be traced to a small mainframe app called 'MAILBOX' from the mid-1960s, human-to-human messages have been created, transmitted and stored in electronic format. But early email administrators could hardly have envisioned the complexity of current email infrastructure and the concomitant maze of technical, security, business and regulatory challenges.

Pakistan late Sunday reversed a block on Twitter in the country over material it considered anti-Islam, the country's interior minister said.

Technical problems at the Nasdaq exchange affected the trading of Facebook shares on Friday, the much-anticipated day of its IPO (initial public offering), Robert Greifeld, chief executive of Nasdaq OMX Group Inc., told reporters on Sunday, according to published reports.

Chinese regulatory authorities have approved Google's acquisition of Motorola Mobility, paving the way for the deal to close within the week, company officials confirmed Saturday.

In the latest move in a complex series of patent-related cases, Apple filed a motion in a U.S. district court late Friday to ban Samsung Electronics' Galaxy Tab 10.1 in the U.S.

Apple's plans for a Bluetooth 4.0-based iWallet could be the beginning of the end for the venerable cash register.

An Italian court has upheld a a!900,000 (US$1.2 million) fine imposed on Apple by Italy's competition authority for allegedly violating consumer protection laws, Italian media reported late Friday.

The mobile gift-giving app Karma announced Friday it has been acquired by Facebook. The announcement came shortly after the markets closed on Facebook's first day as a publicly traded company.

The U.S. International Trade Commission issued an import ban Friday on any Android devices from Motorola that infringe one of Microsoft's patents.

The prospect of cyberwar means the U.S. needs to 'rethink every aspect of defense,' says one summit presenter

At any given moment today, on-the-clock employees are updating their social media status, reading feeds and networking on business media sites. Moments can stretch to minutes: A recent study by the Ponemon Institute found that 60 percent of social media users spend at least 30 minutes a day on these sites while at work.

HP is expected to announce a large layoff at its quarterly investors briefing on Wednesday, losing as many as 30,000 employees. But for now, the company isn't talking about its plans.

How well do you know the $100 billion social network? From private planes to petabytes, here are some of the most surprising Facebook tidbits.

Given the complexity of today's applications, it's folly to suggest that the future role of the CIO is less technical and more businesslike, columnist Bernard Golden writes. If anything, it's the opposite -- the business side of the enterprise should embrace technology.

Twitter has announced support for "Do Not Track," immediately implementing it to halt online tracking of users who trigger a setting in their browsers.

The first hours of Facebook's IPO got off to a shaky start today with the share price wavering around the $40 mark, never gaining the astronomical momentum many had anticipated.

Fully 95% of 600 businesses surveyed by Cisco permit the use of employee-owned smartphones and tablets at the office and found productivity gains for workers who use their own hardware.

Perhaps the Next iPhone won't be called iPhone 5 but the Zombie iPhone, in honor of the new spate of rumors that the late Steve Jobs is still with us in a sense, as the chief designer of the upcoming handset.

The company has now set things straight again and all content on the iTunes Store a including music and apps a now displays the word "jailbreak".

Symantec originally thought that at its peek the Flashback Trojan was generating around $10,000 a day by hijacking ad clicks. Now, new research suggests the developers may only have earned $14,000 during the time that the malware was active.

A hacker who claims to hate both Anonymous and notorious file-sharing website The Pirate Bay has claimed responsibility for the DDoS attack that the bittorent website has been suffering for the last 24 hours.

When Windows 8 comes out later this year, the new Start screen and Metro-style apps will likely be the first changes you'll notice, but those aren't the only things that are new. Microsoft is also making some serious security enhancements to help keep your system safer and to improve Windows' ability to combat viruses and malware. It just may be the biggest improvement to Windows security yet.

Three winners of an academic competition at the University of Rochester to create the most innovative and useful applications for IBM's Watson cognitive computing systems were announced yesterday by Big Blue.

Facebook's initial public offering, or IPO, hits Wall Street Friday, and is one of the most highly anticipated tech stock offerings of the past decade. Everyone, it seems, wants to be in on the action. And it's possible to do so--after the big boys get their hands on it first.

'If the product is free, you are the product.'

Conmen in Manchester have been selling bottles of water, cans of Coke, and even potatoes under the pretence that they are iPhones.

HP is looking to cut at least 25,000 jobs in a bid to reduce costs and return to growth, according to media reports.

Adoption of Android tablets and smartphones in large businesses has been "severely limited" because of the complexities of managing the various Android models and versions, market research firm Gartner said in an evaluation of 20 mobile device management software vendors.

Cisco's Wireless Networking Business Unit doesn't actually talk so much about wireless networking these days. Increasingly, its message aimed at IT groups is about the broader concept of "mobility."

Hewlett-Packard on Wednesday announced the OfficeJet 150 Mobile All-in-One portable printer, which the company called the world's first mobile multifunction device that can "print, copy and scan on the go."

Despite the rumors, developers are focused on making apps -- and money -- from today's Android

Apple is in talks with China Mobile, according to the carrier's chairman Xi Guohua, although an agreement is yet to be reached.

The question of whether CISPA is really necessary might arise in the wake of a Department of Defense announcement last week that as many as 1,000 defense contractors -- and possibly thousands more -- may voluntarily join an expanded program of sharing classified information on cyber threats with the federal government.

If you're a Verizon customer upset that your next smartphone contract won't include unlimited data, Sprint would like to remind you that you have an alternative.

In retaliation against Internet Service Providers (ISPs) blocking some video-sharing and torrent websites like The Pirate Bay under Indian court orders, Anonymous, the "hacktivist" organization, today took down the websites of the ruling Congress Party and the Supreme Court of India. Anonymous, which in the past has been credited with taking down the websites of the MPAA, RIAA, the FBI, the US Department of Justice and child pornographers, took down these sites in what is understood to be DDoS (Distributed Denial of Service) attacks.

The University of Kentucky says it has reshaped its business intelligence capability by adopting SAP's in-memory system, HANA.

The head of the U.S. Patent and Trademark Office tells a congressional panel that the landmark reform bill signed last September is already yielding significant results, but defends litigation in tech sector as a sign of vigorous innovation.

If you haven't developed a corporate Bring Your Own Device policy, or if the one you have is out of date, these tips will help you address device security, IT service, application use and other key components of an effective BYOD policy.

With Facebook's long-anticipated IPO expected to hit on Friday morning, the company set its initial share price at $38 today.

The hackers in charge of the Flashback botnet managed to generate $14,000 from their click fraud campaign, but have not been paid, Symantec said today.

The specification for next-generation mobile DRAM was published, offering smartphone, tablet and ultra-thin notebook makers a 50% increase in memory performance.

Ultrabooks are sleek, super-thin laptops that often feature a silver, wedge or tapering design--yes, just like the Apple MacBook Air.

More than half of US businesses still rely on conventional firewalls or intrusion prevention systems to shield themselves from the scourge of DDoS attacks, a survey by services firm Neustar has found.

Researchers from the Tokyo Institute of Technology in Japan claim to have broken the record for wireless data transmission in the Terahertz band with a data rate 20 times higher than most current Wi-Fi connections.

On the surface, Google's Knowledge Graph seems like just another search feature, but connect the dots and it could become the brains behind a Siri-like virtual assistant.

T-Mobile USA will debut 4 'No Annual Contract' data service plans on Sunday, while Verizon plans to kill unlimited data plans as users shift to 4G

Car giant General Motors has confirmed it will stop advertising on Facebook, after deciding that paid ads on the site have little impact on consumers' car purchases.

Mobile malware stepped up an order of magnitude in volume and sophistication during 2011 and this trend has continued in the first quarter of 2012, according to F-Secure's latest quarterly report.

Spiceworks, the social business platform for IT professionals, has announced that it now has 2 million users, representing nearly 30 percent of all IT pros at small and medium-sized businesses worldwide.

Such activity is often paid for, or sanctioned by, government agencies

AT&T Thursday launched its 4G LTE service in, New Orleans, Baton Rouge and Naples, Fla., today, which extends its high-speed network implementations to 38 markets.

Unless Microsoft allows other browser makers to call important APIs in Windows RT, it's "probably not worth it to even bother" building a version of Firefox for the new OS, a Mozilla product director said.

Felix Ehm, a member of CERN's beams control group, has always had a curious and scientific bent.

Doctors are being cautioned by hospitals they work with to avoid interacting with patients on social media, and that they reject any overtures by patients to interact on the likes of Facebook and Twitter.

With Facebook's initial public offering creating such a frenzy of interest, there's an important question to be considered: What happens if tomorrow or next week or five months from now, this investment goes south?

Comcast is trying out more flexible ways to implement its bandwidth caps by experimenting with tiered service options.

Apple historically has fought iPhone jailbreaking by warning customers that their device warranties will be voided if they muck around with the innards of their Apple products. Now Apple appears to be taking its disapproval of jailbreaking one step further by censoring at least some references to "jailbreak" in its U.S. iTunes store.

Zach Nelson, chief executive at NetSuite, has publicly thanked rival SAP for renewing a cloud computing license with his company, instead of using its own software.

A man from West Sussex has been sent to jail for 12 months after hacking into a private Facebook account.

Apple has apparently won control of the iphone5.com domain, according to changes in a Web record of the URL.

SSD maker RunCore's InVincible SSD can wipe your data using one of two methods: overwriting the entire disk with meaningless code or frying it with voltage.

Social media -- Facebook, Twitter, LinkedIn, Google+ and so forth -- has become a way of life for companies and their employees to interact with the public, but beating back the fraudsters that try to prey on customers, not to mention keeping employees from spilling sensitive data, is becoming a full-time job for many.

The next iPhone, which may or not be called iPhone 5, will have a 4-inch screen according to several unidentified sources cited in news stories this week.

Growth in the Ethernet switch market is now being driven by specialized devices for specific applications, rather than evenly across all customer deployments.

Actress Geena Davis, President of Argentina Cristina Fernández de Kirchner and Huawei Chairman Sun Yafang have been named winners of the 2012 ITU World Telecommunication and Information Society Award for their efforts promoting information and communications technology (ICT) to empower women and girls.

Apple devices -- ever more popular in the workplace -- are about to become more popular with cyber criminals.

The malware business growing around Google Android -- now the leading smartphone operating system -- is still in its infancy. Today, many of the apps built to steal money from Android users originate from Russia and China, so criminal gangs there have become cyber-trailblazers.

T-Mobile USA clarified its latest restructuring plans and said the changes will result in a net 350 job losses, not 900 as reported earlier.

Cisco announced yesterday three pre-tested bundles of products and services designed to cut through the confusing complexity of enterprise mobility.

Developers have discovered that users running iOS 6 have been accessing their apps.

Spam Filters Explained

Spam Blocking Spam Blocking