• What we do
  • The People
  • About Us
  • Why Innovation Africa
  • Contact Us
Innovation AfricaCreating the Future Today
  • Feature Articles
  • Innovation
  • Agriculture
  • ICT
  • Technology
  • Entrepreneurship
  • Health
  • Store
  • Contact Us
Menu
  • Feature Articles
  • Innovation
  • Agriculture
  • ICT
  • Technology
  • Entrepreneurship
  • Health
  • Store
  • Contact Us
  • Need speed for big data? Think in-memory data management

    January 27, 2013 Editor 0

    By Ben Lorica and Roger Magoulas

    In a forthcoming report we will highlight technologies and solutions that take advantage of the decline in prices of RAM, the popularity of distributed and cloud computing systems, and the need for faster queries on large, distributed data stores. Established technology companies have had interesting offerings, but what initially caught our attention were open source projects that started gaining traction last year.

    An example we frequently hear about is the demand for tools that support interactive query performance. Faster query response times translate to more engaged and productive analysts, and real-time reports. Over the past two years several in-memory solutions emerged to deliver 5X-100X faster response times. A recent paper from Microsoft Research noted that even in this era of big data and Hadoop, many MapReduce jobs fit in the memory of a single server. To scale to extremely large datasets several new systems use a combination of distributed computing (in-memory grids), compression, and (columnar) storage technologies.

    Another interesting aspect of in-memory technologies is that they seem to be everywhere these days. We’re looking at tools aimed at analysts (Tableau, Qlikview, Tibco Spotfire, Platfora), databases that target specific workloads or data types (VoltDB, SAP HANA, Hekaton, Redis, Druid, Kognitio, and Yarcdata), frameworks for analytics (Spark/Shark, GraphLab, GridGain, Asterix/Hyracks), and the data center (RAMCloud, memory Iocality).

    We’ll be talking to companies and hackers to get a sense of how in-memory solutions fit into their planning. Along these lines, we would love to hear what you think about the rise of these technologies, as well as applications, companies and projects we should look at. Feel free to reach out to us on Twitter (Ben is @bigdata and Roger is @rogerm) or leave a comment on this post.


    Go to Source

    Related Posts

    • The Behaviour of Cybercafé Users in TanzaniaThe Behaviour of Cybercafé Users in Tanzania
    • How to Emerge from Crisis by Knowing your Innovation Growth Opportunities & Competitors’ Strengths
    • Home-grown digital radiography systems make Gauteng hospital debutHome-grown digital radiography systems make Gauteng hospital debut
    • Changing the Lens: Viewing the Mentoring Relationship as Relational Structures in a Social Exchange FrameworkChanging the Lens: Viewing the Mentoring Relationship as Relational Structures in a Social Exchange Framework
    • Researching tomorrow’s innovative textilesResearching tomorrow’s innovative textiles
    • Farming to Invest in the FutureFarming to Invest in the Future
    Sovrn
    Share

    Categories: Technology

    Tags: Faster query, in-memory solutions, memory

    Kenya: Kenya to Set Up Biggest Data Centre in Konza Nigeria: Science Education As Catalyst for Development

    Leave a Reply Cancel reply

    You must be logged in to post a comment.

Subscribe to our stories


 

Recent Posts

  • SL Crowd Green Solutions September 21, 2020
  • Digital transformation in the banking sector: surveys exploration and analytics August 3, 2020
  • Why Let Others Disrupt You? Take the Smart Self-Disruption Journey! August 3, 2020
  • 5 Tips for Crowdfunding During the Pandemic August 3, 2020
  • innovation + africa; +639 new citations August 3, 2020

Categories

Archives

Popular Post-All time

  • A review on biomass-based... 0.9k views
  • Can blockchain disrupt ge... 684 views
  • Prize-winning projects pr... 678 views
  • Apply Now: $500,000 for Y... 605 views
  • Test Your Value Propositi... 533 views

Recent Posts

  • SL Crowd Green Solutions
  • Digital transformation in the banking sector: surveys exploration and analytics
  • Why Let Others Disrupt You? Take the Smart Self-Disruption Journey!
  • 5 Tips for Crowdfunding During the Pandemic
  • innovation + africa; +639 new citations
  • SME Innovation: 10 Priorities for Support Post-COVID-19 
  • Africa RISING Annual Progress Report 2018 – 2019 now available
  • Fodder beet feed supplementation delivers dairy success for Ethiopian farmers
  • Using theory of change for outcome-oriented research
  • Africa RISING partners publish soil fertility management guidebook

Tag Cloud

    africa African Agriculture Business Business model Business_Finance Company Crowdsourcing data Development East Africa economics Education Entrepreneur entrepreneurs Entrepreneurship ethiopia ghana Health_Medical_Pharma ict Information technology Innovation kenya knowledge Knowledge Management Leadership marketing mobile Mobile phone nigeria Open innovation Organization Research rwanda science Science and technology studies social enterprise social entrepreneurship south africa Strategic management strategy tanzania Technology Technology_Internet uganda

Categories

Archives

  • A review on biomass-based hydrogen production for renewable energy supply 0.9k views
  • Can blockchain disrupt gender inequality? 684 views
  • Prize-winning projects promote healthier eating, smarter crop investments 678 views
  • Apply Now: $500,000 for Your Big Data Innovations in Agriculture 605 views
  • Test Your Value Proposition: Supercharge Lean Startup and CustDev Principles 533 views

Copyright © 2005-2020 Innovation Africa Theme created by PWT. Powered by WordPress.org