Cache at Facebook

ByQ A

About caching system at Facebook.

According to: https://www.facebook.com/notes/facebook-engineering/monitoring-cache-with-claspin/10151076705703920

Facebook has two major cache systems: Memcache, which is a simple
lookaside cache with most of its smarts in the client, and TAO, a
caching graph database that does its own queries to MySQL.

The NSDI’13 paper introduces more about Memcache: https://www.usenix.org/conference/nsdi13/scaling-memcache-facebook

The USENIX ATC’13 paper introduces more about TAO: https://www.usenix.org/conference/atc13/tao-facebook’s-distributed-data-store-social-graph

Read more:

Similar Posts

  • How to iterate all files and directories under a directory in Python?

    ByEric Ma

    How to iterate all files and directories under a directory in Python? For example, I would like to iterate each file and directory under /mnt/data/ /mnt/data/ |– file.txt `– great That is: /mnt/data/files.txt /mnt/data/great You can use the os.walk to do this: root, dirs, files = os.walk(path).next() root will be the path.dirs will contain the…

  • Hadoop 2 (YARN) default configuration values

    ByEric Ma

    Where to check the default Hadoop 2 (YARN) configuration values for: HDFS: hdfs-site.xml YARN: yarn-site.xml MapReduce: mapred-site.xml Default Hadoop 2 (YARN) configuration values for Hadoop 2.2.0 from Apache Hadoop website: HDFS: http://hadoop.apache.org/docs/r2.2.0/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml YARN: https://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-common/yarn-default.xml MapReduce: https://hadoop.apache.org/docs/r2.2.0/hadoop-mapreduce-client/hadoop-mapreduce-client-core/mapred-default.xml Read more: Good introductions to Hadoop 2.0 (YARN)? Hadoop Installation Tutorial (Hadoop 2.x) Hadoop Installation Tutorial (Hadoop 1.x) Hadoop…

  • Good introductions to Hadoop 2.0 (YARN)?

    ByEric Ma

    Which ones are recommended introductions to Hadoop 2.0 (YARN)? Pointers to webpages are good. Those are good ones that I find: The SoCC13 paper “Apache Hadoop YARN: Yet Another Resource Negotiator” by Vinod Kumar Vavilapalli et al.: http://www.socc2013.org/home/program/a5-vavilapalli.pdf The introduction from Hortonworks by Arun Murthy:http://hortonworks.com/blog/apache-hadoop-yarn-concepts-and-applications/ The “Official” one from Apache Hadoop website (very brief):https://hadoop.apache.org/docs/r2.2.0/hadoop-yarn/hadoop-yarn-site/YARN.html Read…

  • Latex Cheat Sheet

    ByEric Ma

    Latest has many commands and it is not easy to quickly remember them all. Then, a cheat sheet will be very useful. Here is a collection of cheat sheets for Latex that I collected from the Web. Latex cheat sheet Latex cheat sheet by Winston Chang: Download latex cheat sheet. LaTeX Math Symbols https://web.archive.org/web/20190707092927/http://web.ift.uib.no/Teori/KURS/WRK/TeX/symALL.html Read…

  • How to use LVM groups with libvirt

    ByQ A

    libvirt uses files for VM images by default under /var/lib/libvirt/images/. LVM is a convenient tool for managing VM images. How to use LVM groups with libvirt? This post discusses the method to add LVM groups as a storage pool for libvirt: http://ailoo.net/2011/02/use-a-lvm-volume-group-with-libvirt/ For a general introduction of the storage management in libvirt, please check: http://libvirt.org/storage.html…

  • How to set replication factors for HDFS directories?

    ByEric Ma

    Is it possible to set the replication factor for specific directory in HDFS to be one that is different from the default replication factor? This should set the existing files’ replication factors but also new files created in the specific directory. This can simplify the administration. We can set the replication factor of /tmp/ to…

Leave a Reply

Your email address will not be published. Required fields are marked *