Building a scalable storage for images in a social network

Jaime Medrano Navarro; Jesús Javier Maestro de la Calle

doi:10.1117/12.912078

21 February 2012 Building a scalable storage for images in a social network

Jaime Medrano Navarro, Jesús Javier Maestro de la Calle

Proceedings Volume 8302, Imaging and Printing in a Web 2.0 World III; 83020G (2012) https://doi.org/10.1117/12.912078
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Images are one of the key components of a social network. A storage for images needs to be highly scalable and provide redundancy, high availability and the ability to grow its size. Efficiency is also required so that disk stage and the need for processing power can be minimized. Tuenti's image storage uses a Content Delivery Network (CDN) as a web cache that allows us to meet high throughput requirements. When an image is not cached in the CDN, it is requested from the Image Routing Layer (IRL), which is in charge of finding its physical location. If the IRL is not able to retrieve the image from one of the locations it can get it from the other copies available, preventing the CDN and the user from noticing the miss. If the requested size is not available in the storage, the IRL will automatically resize the best size available and serve it back. Expensive operations, such as finding the physical location or resizing, are only done when there is a cache miss on the CDN. The physical storage is split in homogeneous buckets that are spread across the storage servers. The growth strategy is to add more Storage Servers and to rebalance buckets towards them. Rebalancing not only provides free space on full servers but also allows the upload bandwidth to increase because there will be fewer buckets per server, and so fewer uploads per server.

Citation Download Citation

Jaime Medrano Navarro and Jesús Javier Maestro de la Calle "Building a scalable storage for images in a social network", Proc. SPIE 8302, Imaging and Printing in a Web 2.0 World III, 83020G (21 February 2012); https://doi.org/10.1117/12.912078

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Social networks

Current controlled current source

Electronic imaging

Fluctuations and noise

Free space

Image retrieval

Image storage

Show All Keywords

Keywords/Phrases

Search In:

Publication Years