Latviski English По-русски
Wednesday 18.07.2018 | Name days: Rozālija, Roze

Secrets of YouTube

(No Ratings Yet)

It’s a technological marvel that YouTube can handle so many users watching so many videos simultaneously. But consider the other side for a moment: Every minute of the day, users upload an average of 72 hours of footage to the site. YouTube engineers tell us how they deal with so much data without getting bogged down

On September 29, at the statistical height of its popularity, the music video for Psy’s “Gangnam Style” received 12.8 million views on YouTube. That translates to an average of 8900 streaming requests for the video per minute, or 148 per second. And it’s not as though Psy’s was the only viral video on YouTube that day, writes Popular Mechanics.

YouTube as a site gets traffic at a level every day that would DDoS a large percentage of other websites,” says Rushabh Doshi, a software engineer at YouTube.

“We get 72 hours of video uploaded every minute. That’s like 36 full-length movies being uploaded to your site every minute,” he says adding that “everything at YouTube is made immensely more complicated because of the scale at which we operate.”

When Doshi joined YouTube in 2007, he says the site was getting 6 hours of video per minute. In the past five years, then, the site has seen a 10-fold increase in volume. But, Doshi says, the amount of data has exploded at an even higher rate. “The insane part is that there has been this huge shift going on from people capturing video at 240p resolution with low-bit-rate cameras to modern consumer devices that are 1080p with 25- to 30-megabit-per-second video streams,” he says. “That really explodes the amount of data that you need to process.”

Digital video has fundamentally changed the Web in the past half-decade, and no company has been more central to that evolution than YouTube. It democratized and popularized video sharing. It provided an opportunity for expression and protest for citizens of oppressive regimes, such as those in Iran, Libya, and Syria. It has also provided a vehicle through which the provocateurs of one culture can incite outrage in another; the video that prompted riots and mayhem throughout the Muslim world was spread through YouTube.

The site has become so synonymous with online video that it’s easy to overlook what a technological marvel it is. The site can ingest video directly from pretty much any source: phones, tablets, connected cameras, computer webcams, what have you. And engineers at the site have worked hard to make some of the complexities of digital video—codecs, bit rate, resolution—invisible to users, doing all of the transcoding and processing on the back end.

YouTube’s upload page, for instance, is embedded with software that can automatically upload and transcode multiple HD video files in real time. To decrease latency, the uploaded video is usually sent to whichever Google data center is geographically closest to the user. “We absolutely obsess over speed,” Doshi says. “One key insight is that you don’t have to wait to have the entire video to start processing it. The other key insight is that we can split up the video into smaller chunks and start processing each chunk separately. This plays really well to Google’s strengths—we have big data centers with lots of computers, so we have the CPU power to throw at it. Instead of trying to process one video on one computer, we break it up and distribute it.”

It is surprising to learn that YouTube doesn’t use any sort of face detection or video analytics tools to try to figure out what each video is about.

YouTube never deletes a video, no matter how few people watch it, unless the video’s owner requests it to be taken down.


Leave a reply

Will Latvians know who elects their president? Draft on open vote «on the move»

On Tuesday, 17 July, Saeima’s Legal Affairs Commission decided to submit for the first reading amendments to the Constitution of the Republic of Latvia that provide for holding election of the country’s president in the Saeima through an open vote, as reported by the parliament’s press-service.

Schengen information system to help prevent tractor theft cases in Latvia

Latvia’s Cabinet of Ministers has supported amendments to the Operation of the Schengen Information System developed by the Interior Affairs Ministry. The aim of those amendments is providing access to the system to ensure public order and security in member states, the ministry explains.

Ministry declares no more free plastic bags for shoppers

From 1 January 2019 onward supermarkets will no longer provide plastic bags to customers free of charge. This will not apply to very light plastic bags, as confirmed by Latvia’s Environment Protection and Regional Development Ministry.

EY auditor’s work in ABLV Bank’s liquidation will be managed by its Polish office

The work of EY work in ABLV Bank’s liquidation process will be managed by its Polish office, as confirmed by company’s representatives.

Estonia sees no geopolitical change after U.S.-Russian summit in Helsinki

Estonian Foreign Minister Sven Mikser has commented cautiously that the U.S.-Russia summit in Helsinki is unlikely to bring fundamental change in the relations between the West, NATO military alliance and Russia.

airBaltic carried record large number of passengers in June

Latvia’s national airBaltic airline carried 1,876,839 passengers to destinations in Europe, Scandinavia, Russia, CIS countries and the Middle East in the first six months of 2018. This is 20% more when compared to the same period of last year, as BNN was told by the company.

Police to investigate possible MPC fraud at Tukums DH CHP plant

One of the largest CHP plants in Kurzeme – SIA Tukums DH – may have been squandering produced heating energy for a long time, which is a serious breach of mandatory procurement component governing rules, TV3 news reports.

Estonian holidaymakers die in Ukraine, media report

Three Estonian holidaymakers in Ukraine, have been found dead in a hotel in the Black Sea resort town of Odessa last weekend, Estonian media report without identifying the three young men.

Languages «a must-have». An interview with ex-president about political market methods and communist approach

There are two ways a political market is realized during closed presidential elections: one involves approval of candidates in exchange for votes, and the other – for money. If it’s the latter, it is best for no one to know how elections are performed. Harmony, which now stays quiet about open elections, has always been against this proposal, because it does not allow for creating a political market – sale of votes in exchange for influence, which has been done before...

Migration from Baltics, Eastern Europe to UK lowest in years

Migration to the UK from the Baltics and other member states of the European Union has been the lowest it has been for nearly four years in 2017, Britain's official statistics show.

Putin in Helsinki denies U.S. election meddling, Trump doesn't object

At the Russia-U.S. summit Helsinki, a key development has been differences in the attitude by U.S. federal officials to Russian interference in the American election process. Days after Washington charged 12 Russians with hacking the computer systems of U.S. officials, U.S. President Donald Trump has accepted the denial of Russian responsibility expressed by Russian President Vladimir Putin.

Stock exchange indexes showing varied trends; oil prices decline

Stock exchange indexes in USA and Europe showed varied trends on Monday, 16 July. Bank profit rise was reported for Q2.

Rezekne Council deputies will not be penalized for releasing newspaper in Russian language

The court has lifted fines previously applied by Corruption Prevention and Combating Bureau on nine deputies of Rezekne City Council for releasing a newspaper produced by the council in Russian language in addition to Latvian.

Volume of imported petrol in Latvia down 2% in five months

The volume of motor fuel imported to Latvia in the first five months has declined 2% in comparison with the same period of 2017. The volume of diesel fuel has declined 14.9%.

Corruption watchdog ends case about Bi-2 concert in Riga

Corruption Prevention and Combating Bureau ended in May the case regarding possible misuse of administrative resources on pre-election promotion by Riga City Council in the form of a free Bi-2 concert in Lucavsala.

Thailand's rescued boys honour casualty of 17-day rescue operation

In Thailand, a 12 boys trapped in a cave have been rescued in a rescue operation that lasted for 17 days and ended with one casualty, a rescue diver.

Latvian political party Progresīvie to nominate women as candidate list leaders

Latvia political party Progresīvie has revealed its list of candidates for 13th Saeima elections. Five women have been stated as leaders of candidate lists.

Estonia earns 150 000 euros from military evaders annually

Estonian compulsory military service is evaded by about 1 000 young men each year, who have to pay fines that annually exceed the combined total of 150 000 euros.

Chairman: FCMC’s competence should end with termination of licenses if banks are liquidated

In the event of liquidation or insolvency, Finance and Capital Market Commission’s competence should end with revoking affected banks’ license and without the need to appoint an administrator, says FCMC chairman Pēters Putniņš.

Minister: Latvia may terminate MPC system in the next three years

In the next three years or so Latvia could completely terminate the mandatory procurement component system, said Economy Minister Arvils Ašeradens in an interview to Rīta Panorāma programme of LTV.

In pictures: French victory in World Cup celebrated by tens of thousands in Paris

After the football World Cup was won by the French national team on Sunday, an enormous crowd of people gathered in central Paris to celebrate.

Another case of African swine fever infection recorded for domestic pigs in Latvia

African swine fever infection was recorded for domestic pigs in Tērvete on Monday, 16 July. 16 pigs were liquidated because of the infection, as reported by Food and Veterinary Service.

MEP Artis Pabriks becomes political party «Attīstībai/Par!» prime minister candidate

Latvian political party «Attīstībai/Par!» has picked Daniels Pavļuts, Juris Pūce, Ilze Viņķele, Artis Pabriks and Mārtiņš Bondars as its regional candidate list leaders. Artis Pabriks will also be the party’s prime minister candidate.

Russian-U.S. presidents meet in Helsinki

U.S. President Donald Trump and Russian President Vladimir Putin are meeting on Monday in Helsinki.

Heat of up to +30° C expected in Latvia this week

Weather in Latvia will be warm and even hot at times this week, as air temperature reaches up to +30° C. At night, air temperature is not expected to go below +20° C. Many regions will likely experience thunderstorms closer to the middle of the week, Environment, Geology and Meteorology Centre reports.

Most read

Most commented

Newest comments