Search results for 'big data'

Big Data, your reputation and how to catch a match fixer

24 Oct

Recently i have been looking at Big Data, i have blogged about big data before, but i have to say, the technology is much bigger than i first thought.


Introducing Social media monitoring



Social media measurement or ‘social media monitoring’ is an active monitoring of social media channels for information,[1] usually tracking of various social media content.

Such as blogs, wikis, news sites, micro-blogs such as Twitter, social networking sites, video/photo sharing websites, forums, message boards and user-generated content in general as a way to determine the volume and sentiment of online conversation about a brand or topic.

What this means is, once you post something online, its always there.

Jay Z wrote a song about it


Software is constantly scanning social media, blogs, websites, videos and pictures to extract the following:

  • Named entities -> Who/ What/ Where ?
  • Themes  -> Whats the buzz?
  • Categories  -> What is it about?
  • Intentions -> What will they do?
  • Sentiments -> How will they feel?

Do you watch soccer?


Introducing a sport data analytics company called Sportradar

The odds on any given contest don’t just represent the potential profit of a single bet; they indicate market confidence in a certain outcome. The tsunami of data gushing into Sportradar gives the company some pretty amazing predictive power about what the odds should be in a vast number of sporting events around the world.

As bookies adjust the odds, Sportradar can detect when gamblers aren’t following the expected betting patterns, when there’s too much money—too much confidence—on one side.

Look closely at a big enough sample, and the way odds move can tell you if a match might be fixed. Sportradar estimates that about 1 percent of all athletic competitions it covers are fixed—and it’s reasonably sure it’s found more than 1,800 fixes since 2009.

noun: match-fixing; plural noun: match-fixings
  1. (in sport) the action or practice of dishonestly determining the outcome of a match before it is played.

The social media comments about gambling by the players here led to police being called

“They weren’t bottom of the league,” Mace said, “but they were 2 points away, simply getting beat 4, 5, 6-nill. This was their sort of modus operandi, which is quite common for football teams when they’re fixing—just get beat heavily. It’s quite easy to profit.

People talk social, then they take action


For this data to be of use, you need to measure:

  1. Precision, If i identify certain things as red, how many were actually red?
  2. Recall, for all the red things in the data set, how many did i identify?

You need to measure:

  1. Entities -> Who do you care about?
  2. Categories -> What affects your business?
  3. Sentiments -> What phrases carry weight?

What this means is even your photos and videos are being analyzed, companies can now trawl through the net and…

  • Identify you
  • Identify products in the photo
  • Identify people your with
  • Identify situations,
  • Judge the mood of the group

Everybody has seen Facebook tagging people


All this would lead you to start thinking about managing your online identity

Identity will be a key factor with financial industry in the future


The kind of things you might suffer if you lose your reputation


A loss of reputation works the same way no matter what you do, it takes years to acquire if you are a

  • plumber
  • accountant,
  • rapper
  • or a football team,

When people lose trust in you, you are finished, so its probably a good idea to manage it, some might call it a business opportunity?

Stay tuned, its not all bad with Big data analytics, you can use this technology for education too, that will be the next blog post.

Big data is becoming bigger than Texas!!

18 Jun

I’ve been meaning to write this one for quite some time and maybe by writing about it, i can forget about it.

Let me explain, i was going to write about ‘Big data’ after hearing about it through Craig Rispin’s mentoring group.

In case your not familiar with this term, ‘Big data‘ is all about making sense of data sets so large that before could not be processed with previous technology. And now, not only that, this data can be visualized, its quite amazing stuff, some examples would be.

In America, Target know when women are pregnant before they do, one guy rang Target to tell them his daughter was only sixteen, turns out she was pregnant. Target have a stragety of getting pregnant women into their store three times before they have the baby, so they like to get a jump start on things.

Someone is pregnant in there, can you see it?


But dont believe me, check out David Mc Candless, you might like to check out his ‘The meaning of colours in cultures’ or ‘The consensus of the 10 top top 100 book charts’

Check out the full list here

Big data

Law firms are now mining big data to understand aspects of law they could before never imagined, mining without getting your fingers dirty, nice!

Not the kind of mining i’m on about


James Surowiecki wrote a book about ‘The wisdom of crowds’,

The opening anecdote relates Francis Galton‘s surprise that the crowd at a county fair accurately guessed the weight of an ox when their individual guesses were averaged (the average was closer to the ox’s true butchered weight than the estimates of most crowd members, and also closer than any of the separate estimates made by cattle experts

If you can measure the crowd, your on to something.

In England, they can track crowds from helicopters to understand what people are doing, where to put services and how better to serve the tax payer, big brother is watching and he’s watching what you ‘Like’ on Face book too, but thats another story…



This is beautiful people, one of the the application for this in medicine

Just think, there are:

  • 19, 599 genes in your body (mine too)
  • Genes make up your gnome
  • Proteins in your body make up your proteome (which is called ‘proteomics’)
  • 200,000 types of RNA are produced in your body
  • Each RNA strand encodes 200,000 proteins

Genes in themselves dont make us who we are, instead they produce proteins, that are dispatched in the body to the genetic will

Its a geometric expansion that gives you 40 billion proteins, and this is why you need big data, there are hundreds of different varieties of proteins in a different cell.

Mapping the gnome consumed terabytes, proteomics will easily reach petabytes (ouch, that a lot of bytes, more than a mosquito in your tent on a summers night!!)

This of this, for hundreds of years, the progress of medicine was restrained by the lack of information. Today, we have so much data, not enough information, the amount of data at the molecular level is beyond the analytical capabilities, and now this data can be turned into knowledge.

And it continues, Epigenetics is the mechanism which the environment alters the behaviour of our genes, it involves a process known as methylation, which occurs when a chemical known as ‘Methyl’ which floats around inside of our cellsattaces to our DNA.

When it does, it turns down the activity of a gene and blocks it from making a particular version of protein in our genes.

All sorts of things can affect DNA methylation in our bodies, such as:

  • Diet
  • Illness
  • Aging
  • Chemicals in the environment
  • Smoking
  • Drugs and medicines

Big data can make sense of it all!!!

And this morning i read how the police are able to use SAP big data analysis of mobile phone tower information in conjunction with reported crimes and come up a list of one or two possible suspects, you wouldn’t need a police force, just one guy to go out and arrest the gulty guy as soon as he did something!

Oh, the savings to the tax payers!


There is no point running criminals, just give up!


The Australian Tax office was using this technology years ago to prove cases of fraud without any proof

And maybe i can forget all about Big data, but i’d seriously doubt it…

%d bloggers like this: