Newer posts are loading.
You are at the newest post.
Click here to check if anything new just came in.

March 01 2013

La lettre et/ou l'image : ce qui est premier ?

Entendant Michel Serres, parcourant le livre de Raffaele Simone (Pris dans la Toile, L’esprit au temps du web, le débat Gallimard trad., 2012), après avoir lu l’entretien entre Boris Cyrulnik et Denis Peschanski (Mémoire et traumatisme : l’individu et la fabrique des grands récits, INA 2012), une question vient à l’esprit : la lettre ou l’image, Qu’est-ce qui est premier ? Autrement dit on parle d’une civilisation de l’oral, une de l’écrit et une troisième du numérique, mais quelle est la place de l’image ? Autrement dit l’image a-t-elle autant de force civilisatrice que l’écrit, le mot, la lettre. Dans la même ligne, Pierre Babin et Marie France Kouloumdjian s’interrogeaient en 1980 sur « les nouveaux modes de comprendre » (Le Centurion, 1983), nous montrent combien nous avons négligé l’image au cours de notre histoire et combien sa mise en avant, via les écrans de cinéma, de télévision et d’ordinateur, nous invite à en mesurer l’importance.

Reposted from02mysoup-aa 02mysoup-aa

February 21 2013

An update on in-memory data management

By Ben Lorica and Roger Magoulas

We wanted to give you a brief update on what we’ve learned so far from our series of interviews with players and practitioners in the in-memory data management space. A few preliminary themes have emerged, some expected, others surprising.

Performance improves as you put data as close to the computation as possible. We talked to people in systems, data management, web applications, and scientific computing who have embraced this concept. Some solutions go to the the lowest level of hardware (L1, L2 cache), The next generation SSDs will have latency performance closer to main memory, potentially blurring the distinction between storage and memory. For performance and power consumption considerations we can imagine a future where the primary way systems are sized will be based on the amount of non-volatile memory* deployed.

Putting data in-memory does not negate the importance of distributed computing environments. Data size and the ability to leverage parallel environments are frequently cited reasons. The same characteristics that make the distributed environments compelling also apply to in-memory systems: fault-tolerance and parallelism for performance. An additional consideration is the ability to gracefully spillover to disk when main is memory full.

There is no general purpose solution that can deliver optimal performance for all workloads. The drive for low latency requires different strategies depending on write or read intensity, fault-tolerance, and consistency. Database vendors we talked with have different approaches for transactional and analytic workloads, in some cases integrating in-memory into existing or new products. People who specialize in write-intensive systems identify hot data (i.e., frequently accessed) and put those in-memory.

Hadoop has emerged as an ingestion layer and the place to store data you might use. The next layer identifies and extracts high-value data that can be stored in-memory for low-latency interactive queries. Due to resource constraints of main memory, using columnar stores to compress data becomes important to speed I/O and store more in a limited space.

While it may be difficult to make in-memory systems completely transparent, the people we talked with emphasized programming interfaces that are as simple as possible.

Our conversations to date have revealed a wide range of solutions and strategies. We remain excited about the topic, and we’re continuing our investigation. If you haven’t yet, feel free to reach out to us on Twitter (Ben is @BigData and Roger is @rogerm) or leave a comment on this post.

* By non-volatile memory we mean the next-generation SSDs. In the rest of the post “memory” refers to traditional volatile main memory.


Older posts are this way If this message doesn't go away, click anywhere on the page to continue loading posts.
Could not load more posts
Maybe Soup is currently being updated? I'll try again automatically in a few seconds...
Just a second, loading more posts...
You've reached the end.

Don't be the product, buy the product!