Data Mining

 
  • add this feed to my.Alltop

    Kevin Hillstrom: MineThatData

  • Sports Commerce Session #2: Draft and Develop

    Kevin Hillstrom
    16 Apr 2015 | 8:10 pm
    In our second session, I describe how "draft and develop" strategies in sports are similar to "customer acquisition and customer retention" in e-commerce / retail. Click here if you do not see the video box below.
  • Incremental Value

    Kevin Hillstrom
    15 Apr 2015 | 8:10 pm
    Let's say I want to move 13-24 month 1x buyers to a second purchase.How much might I be able to spend to make this happen?In our table, the average 13-24 month 1x buyer is worth about $13.50.In our table, the average 0-12 month 2x buyer is worth about $71.65.Intuitively, you might say that you gain $58 of value, so you can spend a fortune.Nope.There are two things we need to know.Actual repurchase rate of 13-24 month 1x buyers.Incremental percentage that we will convert with incremental marketing activities.Percentage of demand that flows-through to profit.Let's pretend that the annual…
  • But A Recent Buyer Is A Good Buyer, Right?

    Kevin Hillstrom
    14 Apr 2015 | 8:10 pm
    For the most part, a recent buyer is a good buyer ... right?Let's take a second look at the grid from last Friday.This table measures direct-channel value for a business that has retail stores and an e-commerce website. So read down the 7-12 month direct recency column ... if the customer has never purchased from retail, the customer is worth $42.66 demand to the direct channel. But now, the customer (surprisingly) walks into the store and buys something. Everybody is happy! Everybody, that is, except for those who manage the website.Why?The value of the customer to the website went up, quite…
  • Catalog Fact Check

    Kevin Hillstrom
    13 Apr 2015 | 8:10 pm
    Two examples requiring fact checks:Via the NEMOA website (click here for the article), you are told that co-ops "insist" that e-commerce brands contribute their names/transactions to the co-ops. "Insist" is an interesting word, because it gives pure online brands the opportunity to say "no", which they do (they tell me they say no), and when they say no, they get to rent the names you freely contribute - and the co-ops keep all the money. At least two co-ops sell your names to e-commerce brands. Ask a CMO at an e-commerce brand - fact check the issue for yourself! Then ask yourself why you…
  • The Masters

    Kevin Hillstrom
    12 Apr 2015 | 8:10 pm
    Some of you watched one of the four major golf tournaments during the past few days. It's labeled as "a tradition unlike any other". Yes, there's a marketing point coming ... for you ... so hang in there!For me, the event signals the formal transition from winter to spring (unless you live in Northern New England). There's something special about putting winter in the rear view mirror, don't you think?For those who have watched The Masters on network television for the past twenty-plus years, the event theme song is as cherished as the event itself. Click here if you don't see the box below,…
 
  • add this feed to my.Alltop

    TIBCO Spotfire's Trends and Outliers

  • Spotfire Tips & Tricks: Accessing Third Party Data Sources Using RinR

    Erik Novik
    16 Apr 2015 | 6:57 am
    RinR is a TIBCO TERR package that enables an analyst to execute Open Source R commands. It is designed for special cases where TERR cannot execute the function directly. One of those use cases is accessing third party data sources that are not directly supported in Spotfire. By encapsulating data query code into a function, Spotfire gets access to all the data sources for which an R package is available. Since arbitrary data tables and document properties can be passed to a TERR function, this method allows for fully parameterized access to relational, Big Data, and NoSQL sources. The…
  • Anatomy of a Decision: Scalability and Governance

    Spotfire Blogging Team
    14 Apr 2015 | 5:55 am
    In the last article in our Anatomy of a Decision series, we described how important it is for data-driven organizations to insert analytcs into their daily workflow to increase user adoption. We also noted that for the use of data and analytics to become pervasive throughout the organization, analytics tools must be easy to access and simple to use for all types of roles. When front-line employees are able to easily retrieve and navigate analytics tools, adoption rates surge. This helps drive greater productivity, faster decision-making, time-to-market, and better business outcomes. In this…
  • California Crews Fight Wildfires Using Cloud Data

    Spotfire Blogging Team
    13 Apr 2015 | 6:40 am
    California crews are no longer just fighting wildfires with bulldozers, land equipment, and air tankers filled with water, fire retardant, or chemicals. Now, they have access to aerial photos, statistics on wind and moisture in the ground, and other related data they can use to prepare them better, according to an article in CIO magazine. The data, which is made available via a private cloud, helps firefighters and their supporting logistics teams respond more effectively to wildfires, according to Tim Garza, director of IT at the California Natural Resources Agency. The agency has…
  • Data Governance: Creating Uniformity, Transparency, and Knowledge for All

    Spotfire Blogging Team
    9 Apr 2015 | 5:55 am
    Analytics deliver the most value when the data supporting it is timely, accurate, and consistently defined. In order for data to meet those criteria, data governance elements must be in place. The benefits of a strong data governance program are many: Having a data governance program and initiative benefits organizations in many ways, including: Reduced costs Improved effectiveness and efficiency Automated and streamlined processes Standardization of procedures Improved decision-making Reduced risk Greater transparency Heightened accountability When is it time to implement a formal data…
  • Predictive Analytics: Do You See Tomorrow?

    Spotfire Blogging Team
    8 Apr 2015 | 6:18 am
    Do you want to know what the future will bring? Predicting future business outcomes, once thought to be a luxury known only to data scientists, is now becoming more ubiquitous—available to business users and knowledge workers across all functions of an organization, like sales, marketing, operations, customer service, etc. Today’s predictive analytics technology allows organizations and empowers business users of all skill levels to make sense of their business data, improve forecasts, and gain a better understanding of their customers, as well as identify and respond to new opportunities…
 
  • add this feed to my.Alltop

    PolicyMap

  • Three tools for healthy food access

    Jonah Taylor
    16 Apr 2015 | 1:27 pm
    Understanding challenges to healthy food access is now three times easier with PolicyMap. Check out our new data and tools for evaluating the strength of your community’s access to healthy fresh foods: 1. Mapping Food Access webinar PolicyMap’s Mapchats series continues next week with  Mapping Food Access. Learn how to use data to increase access to healthy fresh food in your target area. Hear from experts in the field who will tell their stories about how and why data and mapping are indispensable to their work. Wednesday, April 22, 2-3 PM EST  Save your seat → 2. Limited…
  • PolicyMap celebrates National Poetry Month with data poetry

    Kristin Crandall
    16 Apr 2015 | 5:46 am
    Though we specialize in data, we at PolicyMap get excited about a large number of other things as well. This time around, we’re particularly eager to celebrate National Poetry Month 2015 with a data poetry series! While none of us consider ourselves poets, we all have an appreciation for the arts. Throughout the rest of April, we’ll be workshopping poetry about the topics we’re most passionate about (maps, data sources, data processing) and sharing our finest poems with the world! We are going to kick it off with a poetic salute to the source of more than half of our data: the Census!
  • Changes to BLS’s Local Area Unemployment Statistics

    Bernie Langer
    8 Apr 2015 | 10:14 am
    One of our more popular datasets, the Bureau of Labor Statistics’ (BLS) Local Area Unemployment Statistics (LAUS), has undergone some methodological modifications that could affect how you use it. For those of you not interested in hearing the gritty details, the data is now “more gooder”, but newer data is not comparable to data from before January 2010. Also, the metro area data now shows at the new 2013 boundaries. Roughly every ten years, the LAUS program at the BLS reviews their methodology for calculating unemployment (as well as employment and labor force). This way, the data…
  • Work with PolicyMap this Summer!

    Elizabeth Nash
    6 Apr 2015 | 1:56 pm
    We’re interested in talking to people who want to work with our Data Team to help make PolicyMap as powerful, innovative and indispensable to our users as possible. If you’re looking for a summer job, join our team! We’re looking for nerds who can work independently and who want to learn a lot. Before you apply, here are some core values that sum up the PolicyMap experience. If this is you, let us know! Love maps. Needless to say, we are all about maps, and strive every day to make compelling, accurate geospatial representations of the issues our users care about: health, the economy,…
  • Capital Magnet Fund – a New Face in Affordable Housing

    Morgan Robinson
    3 Apr 2015 | 7:57 am
    Every funding source has a story. Affordable housing construction is often synonymous with big players such as HUD programs such as Low Income Housing Tax Credits (LIHTC), HOME Investment Partnerships Program, Community Development Block Grant programs; and USDA’s Rural Development program. In 2008, Congress authorized two additional funding streams for affordable housing and related investments as part of the Housing and Economic Recovery Act: the Capital Magnet Fund (CMF) and the Housing Trust Fund (HTF). These funds, administered by Treasury (though the CDFI Fund) and HUD,…
  • add this feed to my.Alltop

    Revolutions

  • R 3.2.0 released

    David Smith
    17 Apr 2015 | 9:22 am
    The R Core Team announced yesterday that the latest update to R, R 3.2.0 (codename: "Full of Ingredients") is now available. As of this writing the source bundle is available for download, but Mac and Windows binaries aren't yet available. You should be able to download them from your local CRAN mirror in the next day or so. This is the annual major update to R, but looking at the NEWS file, there are no huge user-facing changes that will affect the way you use R. In fact, many of the changes this time round have happened behind the scenes to improve R's engine for…
  • R User Group Meetings this week in the Bay Area and around the world

    Joseph Rickert
    16 Apr 2015 | 9:55 am
    by Joseph Rickert Tracking R user group meetings is a good way to stay informed about what's happening in the R world. On Tuesday the Bay Area useR Group (BARUG) met at AdRoll in San Francisco. It was a mini-conference with 6 talks: Bryan Galvin our host at AdRoll (many thanks for the pizza and beer) kicked off the evening by showing how his company has created Sparkle, a big-league workflow for deploying Shiny Apps. Shivaram Venkataraman of Amplab gave an overview of SparkR, highlighting new features and giving a preview of what's coming. Perry de Valpine presented NIMBLE, a new…
  • Using R in Myanmar (and other low-bandwidth environments)

    David Smith
    15 Apr 2015 | 6:18 am
    R is already in use in well over 100 cities around the world, and now we can add another to the list: Yangon, Myanmar. Ben Marwick is a trainer with Software Carpentry (a non-profit organization devoted to improving basic computing skills among researchers in science, engineering, medicine, and other disciplines), and last month he visited the University of Yangon to teach 23 archaeologists how to use R. Software Carpentry maintains a number of useful resources for teaching R, and Ben began with the "Programming in R" tutorial to get the students familiar with the R command line.
  • RPowerLabs: Electric power system virtual laboratories online

    Joseph Rickert
    14 Apr 2015 | 8:30 am
    by Ben UbahFounder, RPowerLabs No disregard to R's colleagues, R is pioneering the creation of online virtual electric power system laboratories via RPowerLABS. RPowerLABS is a project, with the vision of deploying online, a vast array of highly demanded power system simulations for teaching and research using R. It started as an attempt to apply R to electric power system simulations as seen here. This is one important application of R that hopes to assist electrical power engineering academics in developing nations who are restricted by costly commercial tools and give the…
  • Because it's Friday: Slow Light

    David Smith
    13 Apr 2015 | 2:00 pm
    Space is big. Really big. And, surprisingly, is still seems positively enormous even at the speed of light. Hop on this spaceship of the imagination, ignore the effects of time dilation, and follow a photon from the sun to beyond Jupiter in this humbling video by Alphonse Swinehart: Even travelling at the speed of light, it takes more than 40 minutes to get from the Sun to Jupiter ... and that's peanuts compared entire Solar System, let alone the Milky Way Galaxy. If you have a second monitor, I recommend popping this video on it, putting it full-screen, and enjoying the ride in the…
  • add this feed to my.Alltop

    iTrend Blog

  • Every company is a data company. Ridesharing Economy by the numbers.

    Michael Alatortsev
    23 Mar 2015 | 3:04 pm
    In this example, we’re looking at 3 companies in the ride sharing space: Uber, Lyft, and Gett.  Once these names are configured in iTrend, you can track various public communications to and from each company, automatically classify them by subject (category), sentiment (positive, negative, neutral), and detect customer service or PR issues in real-time. Summary screen shows you how much data exists for the selected time period (this example uses last 7 days): Selecting a particular company (e.g. Uber), will show current consumer sentiment (when talking to the company) and…
  • Researching companies in the Competitive Intelligence space uncovers spam & Twitter abuse

    Michael Alatortsev
    9 Mar 2015 | 1:01 pm
    Disclaimer: we built a product for researching competition.  Part of its core functionality is monitoring Twitter activity related to a given company and determining where their popularity is coming from, and who is influencing it. Naturally, we’re testing the product by monitoring other companies in the Competitive Intelligence space, so we know what we’re up against.  The list of companies we added was determined by questions we’ve been asked by prospects, “how does iTrend compare against X in terms of Competitive Intelligence?”. One company, Owler,…
  • using iTrend Competitive Intelligence module to detect a problem with a cloud provider

    Michael Alatortsev
    6 Mar 2015 | 4:22 pm
    iTrend CI has been tracking the cloud provider space (AWS, Microsoft Azure, Google Cloud).  We saw a sharp spike in negative complaints to the company (Google). Looking into it reveals the #gamergate incident: http://www.ibtimes.com/google-appears-support-gamergate-tweet-then-calls-it-mistake-1838228
  • Snow storm = more Netflix? Last 24 hours of ‘Netflix’ mentions on Twitter

    Michael Alatortsev
    27 Jan 2015 | 10:03 am
    160k of recent twitter mentions on a map Note the hotspot in the North East, where the snow storm hit. Source: 160,000 recent tweets mentioning the word ‘Netflix’, processed and visualized with iTrend on top of Google Maps.  How we determine location: geo coordinates (when available), then profile description if geo is not available. For comparison, this is what last 7 days look like (different geo distribution in the US):
  • VentureBeat: Startups are digging the data to help marketers answer tough questions

    Michael Alatortsev
    6 Jan 2015 | 3:28 pm
    Microsoft Ventures: iTrend is a cloud-based competitive intelligence platform Zack Weisfeld, Microsoft Ventures, is addressing some of the toughest questions faced by marketers in VentureBeat today: How much extra reach is social media adding to your broadcast advertising spend? What creative approaches are clicking with customers and turning them into advocates for your brand? Where are your competitors winning on social media, and where are they vulnerable? What’s the real ROI on your social media spending? How does iTrend fit into this?  We identify actionable metrics in social media:…
 
  • add this feed to my.Alltop

    Analytics, Big Data & Social Media by Quantumventura.com

  • The Hackathon Fast Track, From Campus to Silicon Valley

    11 Apr 2015 | 9:32 pm
    The Hackathon Fast Track, From Campus to Silicon Valley Peter DaSilva for The New York Timesnytimes.com · by STEVEN LECKART · April 6 2015Shariq Hashme squints at his laptop screen as he scrolls through hundreds of lines of computer code. “I can’t even make sense of it right now,” he says with a grimace. The long string of numbers, symbols and letters would usually be intelligible to Mr. Hashme, a 21-year-old computer science major at the University of Maryland, College Park, but at this moment, he’s having trouble even keeping his eyes open. In the last 27…
  • China Is Said to Use Powerful New Weapon to Censor Internet

    11 Apr 2015 | 9:28 pm
    China Is Said to Use Powerful New Weapon to Censor InternetA tool researchers call the Great Cannon is said to have redirected traffic intended for the Chinese search engine Baidu. Reutersnytimes.com · by NICOLE PERLROTH · April 10, 2015SAN FRANCISCO — Late last month, China began flooding American websites with a barrage of Internet traffic in an apparent effort to take out services that allow China’s Internet users to view websites otherwise blocked in the country.Initial security reports suggested that China had crippled the services by exploiting its…
  • 11 Apr 2015 | 9:22 pm

    11 Apr 2015 | 9:22 pm
    Cloud coincidence: Microsoft embraces Docker, HP downgrades HelionHP’s IaaS/PaaS Helion Public venture turns private. Microsoft, with its burgeoning Azure Cloud, announces serious container substrate in the form of its Nano Server, Docker compatibility and additional equivalents.Helion, Helioff. It’s not as bad as that at all, but the effort made to compete with AWS is over, for now. HP is backing away from the pubic cloud and going for perhaps a safer, and more lucrative, future in the private cloud. It’s my guess that inevitably, HP will make a…
  • Move over, Reddit: Tumblr is the new front page of the Internet.

    14 Mar 2015 | 9:23 am
    Move over, Reddit: Tumblr is the new front page of the Internet. By Caitlin Dewey March 11 Follow @caitlindeweySam Cannon attends Tumblr’s NYFW Creators Dinner at Cosme NYC on Feb. 11. (Noam Galai/Getty Images)The Internet story of the year — perhaps of many years — began with a breezy, under-punctuated blog post on the Tumblr of some 21-year-old no one had previously heard of.“Guys please help me,” the blogger wrote, ignorant of the fact that her words would echo in eternity. “Is this dress white and gold, or blue and black?”“The dress,” of…
  • Google's master cloud plan: Buy more infrastructure, charge less for it

    9 Feb 2015 | 9:32 am
    Google's Miles Ward tells how Google plans to let its cloud customers "run like Google".. for less money! techrepublic.com · by Matt Asay · February 8, 2015Google is not yet top-of-mind for enterprises looking to spend big on the public cloud, with Google claiming just 5% of the cloud infrastructure market, compared to Amazon Web Services' (AWS) 28% and Microsoft's 10%. Rather than settle for also-ran status, Google has a strategy for up-ending the cloud market to its advantage.The game plan? Spend big, charge less.How much more is Google spending? In 2014, Google…
  • add this feed to my.Alltop

    Data Science Notes

  • Fit Data #2

    14 Apr 2015 | 2:56 pm
    Why do I need to track my activity and sleep levels so closely?  Well.. here's some insight from a conversation I had today:Other director: "Hey Levi, we're having a meeting on the online project and would like your opinion could you join us for a few minutes?"Me:  "Um, well.. I'm eating cheese fries right now... can you hold.. ah hell, can I bring the cheese fries with me?"Other director: "I guess...."I mainly run/be active because of my massive food habit. But for my activity level I would weigh 300 lbs.  So, I need to nerdily track my activity level, at least for the near…
  • Tuesday Jams #3: Red Fang

    14 Apr 2015 | 7:00 am
    More music I enjoy while working, this time a little more metal.  I got into Red Fang a couple of years ago, thinking they were like a couple of other bands I like, The Melvins and Mastodon.  I listened to them more regularly when my daughter was an infant, and this music would help her go to sleep.  I know, weird little girl. Now, when I'm trying to keep myself awake at work, but not too engaged in the music, Red Fang is the perfect background.Surprisingly Red Fang played Letterman last year, with Paul Shaffer on keyboards. They also make awesome videos:
  • Kansas Election Fraud pt. 2

    8 Apr 2015 | 2:29 pm
    Yesterday's post on election fraud issues in Kansas got quite a bit of response, so I thought I would followup with an additional analysis. Also, R was still open, with my data frame loaded when I got up this morning, so... what the hell.Oh, and this analysis moves quickly into some fairly technical areas, but I think most of them can be understood in general terms.  If you have any methodological questions please post in the comments.Yesterday's AnalysisMy biggest contention from yesterday's model (which was really my implementation of Clarkson's model) is that underlying, unmeasured…
  • Kansas Election Fraud

    7 Apr 2015 | 1:37 pm
    Statisticians need to be careful in the way we communicate with the public.Last week, a Wichita State University statistician filed a lawsuit regarding the Kansas 2014 election.  She is trying to get access to vote machine tallies, to rule out the potential of voter fraud.  Here's a link to the article in the Wichita Eagle.The statistician, who works as a QA engineer, has found some "voting anomalies"... essentially that republicans receive larger than expected vote shares in larger precincts.  Keep in mind that QA (Quality Assurance) engineers are trained to look for…
  • Tuesday Jams #2: Only Lovers Left Alive Soundtrack

    7 Apr 2015 | 7:00 am
    A few weeks ago my wife, a librarian with broad tastes in music, movies and literature, came home with a movie that she thought I would like.  Most of the time, when she brings home a movie from the library, she tends to watch it alone, in recognition that I can rarely sit still for 90 minutes of a movie without becoming very annoying.Anyways, she brought home "Only Lovers Left Alive" .. which stars Tilda Swinton, and is probably the best vampire movie I've ever seen.The movie has a weird pacing, almost reminding you of the slow build of a concept album.  I won't bore you or spoil…
  • add this feed to my.Alltop

    Data Science Notes

  • Fit Data #2

    14 Apr 2015 | 2:56 pm
    Why do I need to track my activity and sleep levels so closely?  Well.. here's some insight from a conversation I had today:Other director: "Hey Levi, we're having a meeting on the online project and would like your opinion could you join us for a few minutes?"Me:  "Um, well.. I'm eating cheese fries right now... can you hold.. ah hell, can I bring the cheese fries with me?"Other director: "I guess...."I mainly run/be active because of my massive food habit. But for my activity level I would weigh 300 lbs.  So, I need to nerdily track my activity level, at least for the near…
  • Tuesday Jams #3: Red Fang

    14 Apr 2015 | 7:00 am
    More music I enjoy while working, this time a little more metal.  I got into Red Fang a couple of years ago, thinking they were like a couple of other bands I like, The Melvins and Mastodon.  I listened to them more regularly when my daughter was an infant, and this music would help her go to sleep.  I know, weird little girl. Now, when I'm trying to keep myself awake at work, but not too engaged in the music, Red Fang is the perfect background.Surprisingly Red Fang played Letterman last year, with Paul Shaffer on keyboards. They also make awesome videos:
  • Kansas Election Fraud pt. 2

    8 Apr 2015 | 2:29 pm
    Yesterday's post on election fraud issues in Kansas got quite a bit of response, so I thought I would followup with an additional analysis. Also, R was still open, with my data frame loaded when I got up this morning, so... what the hell.Oh, and this analysis moves quickly into some fairly technical areas, but I think most of them can be understood in general terms.  If you have any methodological questions please post in the comments.Yesterday's AnalysisMy biggest contention from yesterday's model (which was really my implementation of Clarkson's model) is that underlying, unmeasured…
  • Kansas Election Fraud

    7 Apr 2015 | 1:37 pm
    Statisticians need to be careful in the way we communicate with the public.Last week, a Wichita State University statistician filed a lawsuit regarding the Kansas 2014 election.  She is trying to get access to vote machine tallies, to rule out the potential of voter fraud.  Here's a link to the article in the Wichita Eagle.The statistician, who works as a QA engineer, has found some "voting anomalies"... essentially that republicans receive larger than expected vote shares in larger precincts.  Keep in mind that QA (Quality Assurance) engineers are trained to look for…
  • Tuesday Jams #2: Only Lovers Left Alive Soundtrack

    7 Apr 2015 | 7:00 am
    A few weeks ago my wife, a librarian with broad tastes in music, movies and literature, came home with a movie that she thought I would like.  Most of the time, when she brings home a movie from the library, she tends to watch it alone, in recognition that I can rarely sit still for 90 minutes of a movie without becoming very annoying.Anyways, she brought home "Only Lovers Left Alive" .. which stars Tilda Swinton, and is probably the best vampire movie I've ever seen.The movie has a weird pacing, almost reminding you of the slow build of a concept album.  I won't bore you or spoil…
 
Log in