Data Mining

  • Most Topular Stories

  • R User Group Activity

    Revolutions
    Joseph Rickert
    5 Mar 2015 | 8:30 am
    by Joseph Rickert R user group activity is still on the rise. The following plot of the number of R user group meetings listed on Revolution Analytics' Community Calendar over the most recent 114 weeks shows a slight  to upward trend along with a couple of annual cycles. Predictably, meetings trail off in the summer months and again late in the year during the holiday season. The 157 user groups currently listed in Revolution Analytics' R User Group Directory reflects a real growth spurt. In the past six months, 13 new R user groups were founded! City            Group Name…
  • EU-FP7 DATA SIM Project Studies Consequences of Mass Switch to Electrical Vehicles

    Data mining News
    6 Mar 2015 | 2:05 pm
    … greener. ‘For the first time data mining, database management, complex systems, transport …
  • Behind the Numbers: Where to Find Help Counting Calories

    The Numbers
    Jo Craven McGinty
    6 Mar 2015 | 9:28 am
    Recommendations for healthy eating are often based on a 2,000-calorie diet, but that figure isnt appropriate for everyone. Some people need more calories, some need less. Now, the government is getting in the game of helping Americans figure out how much is right for them.
  • Vendor Leadership Management - Relegating Vendors

    Kevin Hillstrom: MineThatData
    Kevin Hillstrom
    5 Mar 2015 | 8:10 pm
    Vendor Leadership Management is going to be an alien concept to most of your vendor partners. Since beginning this series, you've told me about your challenges ... lying and/or cheating vendors, and amazing vendors who work with honesty and integrity.The process I've outlined is reasonably straightforward.First, you run a Diagnostics analysis on your housefile. This is not altogether different than getting your annual physical. Your in-house staff (or me) analyze your business from top-to-bottom, illustrating where you have health, pointing out the cases where your customer file is…
  • PRC Rejects Standard Mail Price Increases

    Latest articles from Direct Marketing News
    Direct Marketing News
    6 Mar 2015 | 11:11 am
    Citing a large number of errors and omissions in the rate request, the Postal Regulatory Commission returns it to the Postal Service for modifications
 
  • add this feed to my.Alltop

    The Numbers

  • Behind the Numbers: Where to Find Help Counting Calories

    Jo Craven McGinty
    6 Mar 2015 | 9:28 am
    Recommendations for healthy eating are often based on a 2,000-calorie diet, but that figure isnt appropriate for everyone. Some people need more calories, some need less. Now, the government is getting in the game of helping Americans figure out how much is right for them.
  • Number of the Day: 5000

    Brian Hershberg
    3 Mar 2015 | 8:16 am
    For the second consecutive day, The Numbers is going back to the Nasdaq 5000 well for its Number of the Day honoree. Congratulations to our first repeat winner.
  • Number of the Day: 5000

    Brian Hershberg
    2 Mar 2015 | 7:11 am
    After rising 328.29 points last month, the Nasdaq Composite Index stands 36.47 points away from the 5000 level last seen in 2000. It took 29 years to hit 5000 the first time. Now, 15 years and a brutal bear market later, that milestone is again within reach.
  • How Much Have Sea Levels Climbed? It’s Hard to Say

    Brian Hershberg
    27 Feb 2015 | 11:43 am
    This week in The Numbers, our fearless numerical explorer Jo Craven McGinty dives into sea level measurements. Her finding? Sea levels are hard to pin down. Data collection has been inconsistent. And the physics of the moving world isn't helping things.
  • Number of the Day: 2/29

    Brian Hershberg
    27 Feb 2015 | 7:51 am
    Happy birthday, leap day babies! The Numbers, fascinated by all things leap, would never forget. While those fortunate enough to have been born on Feb. 29 won't have an actual "birthday" this year, that doesn't mean they have no reason to celebrate. They were still born. But when to celebrate?
  • add this feed to my.Alltop

    Kevin Hillstrom: MineThatData

  • Vendor Leadership Management - Relegating Vendors

    Kevin Hillstrom
    5 Mar 2015 | 8:10 pm
    Vendor Leadership Management is going to be an alien concept to most of your vendor partners. Since beginning this series, you've told me about your challenges ... lying and/or cheating vendors, and amazing vendors who work with honesty and integrity.The process I've outlined is reasonably straightforward.First, you run a Diagnostics analysis on your housefile. This is not altogether different than getting your annual physical. Your in-house staff (or me) analyze your business from top-to-bottom, illustrating where you have health, pointing out the cases where your customer file is…
  • Profit And The Partner Dashboard

    Kevin Hillstrom
    4 Mar 2015 | 8:10 pm
    Since I started going down this path after incessant cataloger complaints about co-op productivity declines, I thought I'd show you how one might evaluate the co-ops (and ultimately, every other vendor) within our Vendor Leadership Management framework.I am not concerned with absolute profit improvement. I care about improvement. If a co-op was wildly unprofitable last year and becomes marginally unprofitable this year, the co-op made an improvement, and deserves to be rewarded for that - not necessarily with increased circulation, but certainly within the constraints of the framework.In the…
  • Target Sacks Thousands Of Salaried Employees - And Other Omnichannel Nonsense

    Kevin Hillstrom
    3 Mar 2015 | 8:12 pm
    Click here for the news about Target.Omnichannel experts want you to fully digitize your business ... they want you to allow your customers to buy wherever, whenever. Expand in Canada! Grow your online business! Digitize the store! Do it all!Did you read the article yet? Go back and read it. Ok, you're lazy. You want me to outline the facts for you. Fine. Here we go:Target's omnichannel international expansion failed miserably.Target winds up being $2,000,000,000 in the red in Canada.Wall Street doesn't like it when you lose billions of dollars on an omnichannel international…
  • Assigning Scores In The Partner Dashboard

    Kevin Hillstrom
    3 Mar 2015 | 8:10 pm
    Vendor Leadership Management is a big deal, folks. If you aren't clear about how your vendor team should support you, your vendor team will support you in a way that is most beneficial to individual vendors, right?Each month, you update your entire vendor team on their comparative overall status.In the email sent to every vendor, every employee in your department, and every member of your Executive Team, you give specific praise to the top 20% of the list ... in our case, the top three (Social Media Agency, Email Service Provider, Pay-Per-Click Vendor). Be specific about what each group is…
  • Aligning Goals With The Vendor/Partner Dashboard

    Kevin Hillstrom
    2 Mar 2015 | 8:10 pm
    Ok, you spent an hour at your Vendor Accountability Summit communicating the situation your company is in. Your vendor partners took diligent notes.Now, you're going to share with your vendor partners how they will be evaluated in the upcoming year.Your goals and objectives are split three ways ... profit ... new + reactivated buyers ... and winning new items.This means that you must evaluate your vendor partners via the same objectives. You have no choice, folks. If you want to be successful, and your employees are aligned along these objectives, then you must hold your vendor partners…
 
  • add this feed to my.Alltop

    TIBCO Spotfire's Trends and Outliers

  • The Need for Speed: Faster Data Explorations

    Spotfire Blog Editor
    6 Mar 2015 | 5:58 am
    We all aspire to achieve “insights at the speed-of-thought” in our everyday interactions with data. Given the ever-compounding volume, velocity, complexity, and variety of data generated today, the need to explore data with speed is becoming imperative so users can transform their data challenges into growth opportunities and gain insights faster. So what does faster data exploration really imply? There are numerous ways to achieve faster data exploration in order to recognize the value in your data and make better, informed business decisions. It starts with a streamlined analytics…
  • “Smart” Analytics Transform Your Big Data to Help You Find Insights

    Spotfire Blog Editor
    5 Mar 2015 | 5:55 am
    The rate at which data is being generated in our world today is growing at an astounding rate—think structured data, unstructured text-based content, sensor data, weblogs, social data, and so much more. Analysts forecast that every two years, the amount of information created is doubling and size of data are sets increasing. The Internet of Things is expected to create over 400 zettabytes of data by 2018, according to v3 technology news. Of course, the data is only as good as the insights it provides and the incremental value derived from it. Do you know the best way to visualize your data?
  • You Too Can Become a Data Analytics Artist

    Spotfire Blogging Team
    4 Mar 2015 | 5:55 am
    Have you ever wondered about the impact colors can have when you present your ideas in say, a presentation, a flip chart, an infographic, website, or an analytics report or dashboard? Does color make these ideas more well received, or less? Colors affect people differently depending on the subject matter and the applied design, among other things. For example, yellow is often seen as the brightest color in the spectrum and may be associated with happiness and sunshine. However, in other circumstances, it could portray cowardice and deceit. This is a good example of how important it is to…
  • Make Data Analytics Pervasive within Your Organization

    Spotfire Blogging Team
    3 Mar 2015 | 5:55 am
    Did you know that a whopping 75% of knowledge workers do not use analytics to make critical business decisions? Ever wonder why? Perhaps they don’t have the time or the right tools or the expertise necessary to perform effective analytics. Isn’t it time now for analytics to become easier, faster, and more accessible to the non-expert knowledge worker? For the non-expert user, exploring data can be a challenge. Sure, you can dump your data into a tabular report, but once you start looking at more than 10,000 rows or even 100,000 rows of data, it becomes difficult to assimilate and make…
  • Unleashing the Power of SAP Business Warehouse with Data Analytics

    Spotfire Blogging Team
    2 Mar 2015 | 5:55 am
    In today’s “Age of the Customer,” organizations that can quickly harness Big Data to make fast decisions will outperform their competitors. Organizations have to transform their data into strategic assets that will allow better decision-making for optimum business outcomes. The best way to do that is by using analytics tools to collect massive amounts of big data, extract meaning from that data and use it to drive real growth. Business analytics can help firms unleash the power of collective insight by delivering enterprise business intelligence, agile visualizations, and advanced…
 
  • add this feed to my.Alltop

    PolicyMap

  • Mapping the Way to Wisdom

    Katie Nelson
    6 Mar 2015 | 1:50 pm
    Maggie McCullough, our tireless leader and the person who first conceived of PolicyMap, has been featured in the Heron Foundation’s Influencer Series. The Series is called “Mapping the Way to Wisdom” and describes how people use PolicyMap to get data about the places they work in and care about. Maggie also talks about the inspiration for PolicyMap and what motivates our team here to do what we do everyday. Here’s an excerpt: “Success to me is seeing Policy Map in use by cities across the countries, multiple agencies, using it, thinking about where they’re making…
  • MPIP and PolicyMap: A Great Way to Partner!

    Maggie McCullough
    3 Mar 2015 | 8:33 am
    Metropolitan Philadelphia Indicators Project (MPIP) today released new interactive maps powered by PolicyMap. Available data on the MPIP maps include mortgage lending, land area, demographics, educational attainment, housing characteristics and employment for each community that comprises the Delaware Valley Region – a nine county region in Pennsylvania and New Jersey centered on Philadelphia. Data is available for any of MPIP’s public visitors for exploration in interactive maps and can be easily downloaded. MPIP is an effort of Temple University in Philadelphia and began as one of the…
  • The Changing of the ZIPs

    Bernie Langer
    27 Feb 2015 | 12:23 pm
    Mr. Zip ZIP codes change. Longtime blog readers know this. They’re based on mail delivery routes and post office locations, not on established neighborhood areas. While a neighborhood might stay the same, a local post office can close and change the whole ZIP code makeup of the area. Our ZIP code boundaries come from a company called Maponics. They update their ZIP code maps constantly, based on information from the U.S. Postal Service. In order to maintain some order to our maps, we update our ZIP codes once a year. That update has just happened, so if you go to PolicyMap now, you can see…
  • Mapping Arts & Culture; CultureBlocks a Bright Idea!

    Katie Nelson
    23 Feb 2015 | 6:16 am
    PolicyMap is thrilled to report that CultureBlocks has been recognized as a bright idea by the Ash Center at Harvard University. CultureBlocks is a free mapping tool that supports the arts and cultural community in Philadelphia and supports people making decisions about place and creativity. The site is powered by PolicyMap and we worked with an incredible team to develop the site. Congratulations to our partners at Philadelphia’s Office of Arts, Culture and the Creative Economy (OACCE), the Department of Commerce, and the Social Impact of the Arts Project (SIAP). Click here to see more…
  • Easy Mapping for Public Health Insights

    Kristin Crandall
    20 Feb 2015 | 7:23 am
    In case you missed the Insights into Public Health webinar, we have posted the session below with some great details regarding the datasets! We hope you found it valuable but please don’t hesitate to contact us with any additional questions. As mentioned during the webinar, PolicyMap has a wealth of data that can be useful for a Community Health Needs Assessment (CHNA) or other work in the public health realm. This includes data concerning physical health, infant and maternal health, uninsured populations, various federal programs, and the location of health facilities such as hospitals and…
  • add this feed to my.Alltop

    Revolutions

  • Because it's Friday: A strange undersea extraction

    David Smith
    6 Mar 2015 | 2:12 pm
    Clearly these divers are underwater. But what are they extracting with their drills and ... a wheelbarrow? It's always interesting how strange things can look with a twist in perspective! And don't worry, the wheelbarrow was recovered from the bottom of the amazingly clear Lake Saarijärvi in Finland. That's all for this week. We'll be back on Monday — see you then!
  • Welcome to the Hadleyverse

    David Smith
    6 Mar 2015 | 6:00 am
    It's fair to say that Hadley Wickham, chief scientist at RStudio and a new member of the R Foundation, has made great contributions to the R community. Not only is he the author of several R-related books including Advanced R, Hadley is also the author of dozens of R packages which have transformed the way that data scientists work with R. His packages include an entirely new graphics system (actually, two), a powerful language for manipulating data, tools for importing data files, and developer tools for other R package authors that have influenced R packages way beyond his own.  If…
  • R User Group Activity

    Joseph Rickert
    5 Mar 2015 | 8:30 am
    by Joseph Rickert R user group activity is still on the rise. The following plot of the number of R user group meetings listed on Revolution Analytics' Community Calendar over the most recent 114 weeks shows a slight  to upward trend along with a couple of annual cycles. Predictably, meetings trail off in the summer months and again late in the year during the holiday season. The 157 user groups currently listed in Revolution Analytics' R User Group Directory reflects a real growth spurt. In the past six months, 13 new R user groups were founded! City            Group Name…
  • Color extraction with R

    David Smith
    4 Mar 2015 | 1:49 pm
    Given all the attention the internet has given to the colors of this dress, I thought it would be interesting to look at the capabilities for extracting colors in R. R has a number of packages for importing images in various file formats, including PNG, JPG, TIFF, and BMP. (The readbitmap package works with all of these.) In each case, the result is a 3-dimensional R array containing a 2-D image layer for each of the color channels (for example red, green and blue for color images). You can then manipulate the array as ordinary data to extract color information. For example, Derek Jones used…
  • Plotly Graphs with Domino's New R Notebook

    Joseph Rickert
    3 Mar 2015 | 8:26 am
    by Matt Sundquistco-founder of Plotly Domino's new R Notebook and Plotly's R API let you code, make interactive R and ggplot2 graphs, and collaborate entirely online. Here is the Notebook in action: Published R Notebook To execute this Notebook, or to build your own, head to Domino's Plotly Project. The GIF below shows how to get started: choose an R session, press "Open Notebook", and choose the "R Notebook" file. For sensitive data, see Domino On-Premise and Plotly Enterprise. Overlaid Histogram This plot, like the rest in this post, was made in the R…
  • add this feed to my.Alltop

    Analytics, Big Data & Social Media by Quantumventura.com

  • Google's master cloud plan: Buy more infrastructure, charge less for it

    9 Feb 2015 | 9:32 am
    Google's Miles Ward tells how Google plans to let its cloud customers "run like Google".. for less money! techrepublic.com · by Matt Asay · February 8, 2015Google is not yet top-of-mind for enterprises looking to spend big on the public cloud, with Google claiming just 5% of the cloud infrastructure market, compared to Amazon Web Services' (AWS) 28% and Microsoft's 10%. Rather than settle for also-ran status, Google has a strategy for up-ending the cloud market to its advantage.The game plan? Spend big, charge less.How much more is Google spending? In 2014, Google…
  • The whole world is sucking down mobile data like it’s water

    8 Feb 2015 | 6:54 pm
    The whole world is sucking down mobile data like it’s waterAccording to the latest reports from Cisco, the entire world is going to go from consuming about 2.5 exabytes a month in 2014 to 25 exabytes a month in 2019, with a large portion of that growth coming from adding new device users in developing countries in Latin America, China and the Middle East. Just for comparison’s sake, an exabyte is a billion gigabytes.gigaom.com · by Stacey Higginbotham · February 3, 2015We may be pushing more of our cellular activity over to Wi-Fi, but we’re still guzzling mobile…
  • Report: 80% of all mobile data is consumed by just 10% of users

    8 Feb 2015 | 6:48 pm
    Report: 80% of all mobile data is consumed by just 10% of usersOnly 10% of mobile users are consuming 80% of the world’s mobile data traffic and the top 20% users consume nearly 4 gigbytes per month, according to Gigaom. gigaom.com · by Kevin Fitchard · February 4, 2015Cisco Systems this week offered some insight into just how much mobile data the world is consuming — 2.5 exabytes a month, to be exact – and now a new report from Amdocs sheds a little light on who among those billions of users is consuming the most. Amdocs found that just 10 percent of…
  • Top 10 Social Media Blogs: The 2015 Winners!

    8 Feb 2015 | 5:16 am
    Top 10 Social Media Blogs: The 2015 Winners! socialmediaexaminer.com · by Cindy King · February 5, 2015Are you looking for some good social media blogs to read? Look no further!Our sixth-annual social media blog contest generated over 600 nominations.A panel of social media experts carefully reviewed the nominees and finalists. Each of the social media blogs was analyzed based on a number of factors, including content quality, post frequency and reader involvement.With that in mind, here are 10 social media blogs to put at the top of your reading…
  • Twitter Big Data AnomalyDetection tool goes open source - ZDNet

    9 Jan 2015 | 6:23 pm
    Twitter AnomalyDetection tool goes open source | ZDNet Charlie Osborne Twitter has opened up suspicious activity tracker AnomalyDetection to developers.The social media giant said on Tuesday the tool, dubbed AnomalyDetection, is used by the firm’s team to detect unusual traffic events including traffic spikes and surges, as well as the presence of spam bots. In the world of Big Data, such spikes on a company’s networks can negatively impact service by flooding Internet lanes, causing denial-of-service problems and website crashes, as well as irritating users on an…
 
  • add this feed to my.Alltop

    Data Science Notes

  • On Weird Metrics

    6 Mar 2015 | 7:20 am
    In my job, I spend a lot of time telling people they're looking at the wrong metrics. Yesterday I came upon an article that many people have read this week, reacting with varying levels of shock, outrage and apathy.  The article was Justin Wolfer's New York Times story on the "glass ceiling" which pointed out mainly that more men named John run companies than women in total run companies. (Found here)  There's a fun death penalty analysis coming, but first I'll be nerdy about metrics...My first reaction to this story was... what a bizarre fucking metric.  I understand what they…
  • When a team member is being a resource hog...

    3 Mar 2015 | 2:45 pm
    (no real content in this post, just me having fun with a team)Teach them a lesson by killing all of their sessions...--drop table #tempcreate table #temp (spid int, ecid int, status varchar(255),loginname varchar(255), hostname varchar(255), blk int, dbname varchar(255), cmd varchar(255), request_id int)insert into #tempexecute sp_whodeclare @spid intdeclare @sql varchar(max)DECLARE state_scroll CURSOR FORselect spidfrom #tempwhere loginname like '%levi%'OPEN state_scrollFETCH NEXT FROM state_scrollINTO @spidWHILE @@FETCH_STATUS = 0BEGINset @sql = 'kill ' + cast(@spid as…
  • Board Deck Week

    2 Mar 2015 | 10:06 am
    I sit here Monday morning with about ten data requests littering my inbox.  All due by Wednesday.  While this is not an unmanageable task (in fact if I wanted to, and skipped a meeting, I could probably have these all done by noon without any team member help), but it is quite a task to undertake and verify accuracy of results.The requests are data for various decks and charts to be  presented at this weeks Board of Directors meeting.  I'm seeing three general categories of requests. Ad hoc query requests. Example: what do customer growth trends look like over time? Ad hoc…
  • Day in the life

    23 Feb 2015 | 12:28 pm
    It struck me last week that a majority of my job as a Data Science manager is fairly mundane office work or IT work, which is necessary but a little boring.  I thought it might be interesting to document my priorities for a fairly average day.Notable in this, is that I spend very little time actually building models.  Most of my time is spent debugging business problems or communicating prior results to other Director/Executives.Anyways, here's what I did in a fairly typical Monday in February, 2015.Approve timesheets: This is as boring as it sounds.. it's actually approving…
  • Model to Revenue

    18 Feb 2015 | 12:41 pm
    An area I have struggled with is converting predictive algorithms into revenue maximizing calculations.  Because I create models for a financial services company, I sometimes would have a hard time finding an optimization point, or being able to show the exact business impacts of a model.My boss is the CFO, so he always wants to know revenue impact, and often, my model only outputs predictions of some intervening variable. Should the model increase revenue? Absolutely.  How much? Well...There are a few factors that feed into this difficulty:Dependent variable: By the nature of…
Log in