Multimedia Communications using Scalable Video Coding

My recent paper: Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC

hope — Sun, 05 Feb 2012 17:01:22 -0800

Eun-Seok Ryu, Nikil Jayant, “Home Gateway for Three-Screen TV Using H.264 SVC and Raptor FEC”, IEEE Transactions on Consumer Electronics (TCE), Vol. 57, No. 4, Nov. 2011.

Please find the attached paper.
Video demo: http://sites.google.com/site/hoperyu/videos

Visual Leak Detector - Enhanced Memory Leak Detection for Visual C++

hope — Fri, 11 Nov 2011 13:17:36 -0800

There have been many ways to detect memory leak.
BTW, this tool (Visual Leak Detector - Enhanced Memory Leak Detection for Visual C++) seems to make it easy.
If you add some lines of your code into the reference software such as JM, JSVM, JMVC, and HEVC for your video standard proposal or for research, this tool may be helpful to you.

http://www.codeproject.com/KB/applications/visualleakdetector.aspx#xx1440875xx

[jct-vc] HM-4.0 anchors

hope — Thu, 15 Sep 2011 12:35:48 -0700

This link provides the performance results of HM-4.0 anchors with test sequences.
I will save your time so much. : )

------------------
From David Flynn's email :
------------------

Dear Experts,

Please find copies of the HM-4.0 anchor bitstreams available at:
ftp://ftp.kw.bbc.co.uk/hevc/hm-4.0-anchors/

Anchors were produced by Docomo and the BBC. Cross-checking showed
there were no deviations in PSNR or bitrate for all sequences, with
the exception of SlideShow in random-access configurations as
previously mentioned (The provided bitstreams and configuration files
use the intended IntraPeriod as speficied in HM-4.0).

An excel report showing comparing the Docomo and BBC results is
available at: http://tinyurl.com/3cr3f52

Additional verification tests have validated the encoder bitrate and
PSNR reporting through use of external tools.

Please note:
- Only encoded bitstreams are provided (7.7 GiB).
- Decoded bitstreams are not provided due to their excessive size (~649GiB)
- MD5sums of decoded Y'CbCr pictures have been provided.
- Anchors are provided for all eight common conditions

Further details may be found in the README.txt:
ftp://ftp.kw.bbc.co.uk/hevc/hm-4.0-anchors/README.txt

If there are any issues with the download, please don't hesitate to
contact me.

Kind regards,

..david

Download JVT's H.264 SVC standard (AVC Scalable Extension)

hope — Fri, 19 Aug 2011 17:01:29 -0700

ITU-T opens its standard including H.264 AVC, SVC, and MVC.

You can download the standard document (H.264 : Advanced video coding for generic audiovisual services) from here :

Standard and implementer's guide (AVC, SVC, and MVC).

T-REC-H.264-201003-I!!PDF-E.pdf

T-REC-H.Imp264-201007-I!!MSW-E.doc

T-REC-H.Imp264-201007-I!!PDF-E.pdf

Otherwise, you can download them from this link : http://www.itu.int/rec/T-REC-H.264

Using patent license : MPEG LA http://www.mpegla.com/main/default.aspx
Patent list : (Aug 2011) http://www.mpegla.com/main/programs/avc/Documents/avc-att1.pdf

YUV ROI Merger for SVC Slice-group experiment (FMO mode 2).

hope — Thu, 11 Aug 2011 16:35:19 -0700

This application is for YUV-level ROI merger.
We use "sgconf_layer#.cfg" file when we encode SG-based SVC bitstream.
If it is FMO mode 2 (fore ground and background map), you may have two numbers such as 271 and 1314.
With those numbers, this application crops the area of 2nd YUV file's foreground slice group, then it paste it into the same area of 1st YUV file.
Here, we assume that the 1st file was up-sampled to the same size of 2nd file (I am using JSVM's downconvertstatic tool).

This applications supports only Y-component copying because I wanted to measure Y-PSNR only instead of the PSNR of chrominance components.

As shown in above, the Soccer sequence was embedded in Barbour sequence.
Currently, this application supports just only 1 foreground slice group. But, you can extend it or run this multiple time with different MB#.

This was implemented my personal research.
Here is the source code.
=======================================================================

// ErrorConcealment_BL_US.cpp : Defines the entry point for the console application.

#include "stdafx.h"

#include <stdio.h>

#include <stdlib.h>

int main(int argc, char* argv[])

{

FILE *infile1;

FILE *infile2;

FILE *ofile;

unsigned int w1, h1, sMB, eMB, w2, h2, nSkip, nFrm, nCurFrm=1, nStart;

errno_t err;

printf("\n----------------------------------------------------------------------------\n");

printf(" ErrorConcealment_BL_US: only provide Y-component \n");

printf(" Implemented by Eun S. Ryu \n");

printf(" Aug 11. 2011 \n");

printf(" Usage: exe <EL Width> <EL Height> <in1:US-BL> <in2:EL> <ofile> <start#MB> <end#MB> <skip frm> <frm to be processed>\n");

printf(" Example : exe 352 288 in1.yuv in2.yuv out.yuv 24 92 100 50\n");

printf("----------------------------------------------------------------------------\n\n");

if(argc != 10) { printf(">Check input parameters.\n"); exit(1);}

w1 = atoi(argv[1]);

h1 = atoi(argv[2]);

sMB = atoi(argv[6]);

eMB = atoi(argv[7]);

nSkip = atoi(argv[8]);

nFrm = atoi(argv[9]);

if((err = fopen_s(&infile1, argv[3], "rb" ))!=0) { printf(">Check 1st input file\n"); exit(1);}

if((err = fopen_s(&infile2, argv[4], "rb" ))!=0) { printf(">Check 2st input file\n"); exit(1);}

if((err = fopen_s(&ofile, argv[5], "wb" ))!=0) { printf(">Check output file\n"); exit(1);}

//===== initialization ======

unsigned int nSizeEL = w1*h1*3/2;

unsigned char *cFrmBuffer1 = (unsigned char*)malloc(nSizeEL);

unsigned char *cFrmBuffer2 = (unsigned char*)malloc(nSizeEL);

//======= skip first #nSkip frames =======

fseek(infile1, nSkip*nSizeEL, SEEK_SET ); //support YUV 4:2:0

fseek(infile2, nSkip*nSizeEL, SEEK_SET ); //support YUV 4:2:0

nStart = ((sMB-1)/(w1/16))*w1*16 + ((sMB-1)%(w1/16))*16; //MB unit calc.

w2 = ((eMB-sMB)%(w1/16)+1)*16;

h2 = ((eMB-sMB)/(w1/16)+1)*16;

for(unsigned int j=0; j<nFrm; j++)

{

//===== load two input frames into memory =====

fread(cFrmBuffer1, 1, nSizeEL, infile1);

fread(cFrmBuffer2, 1, nSizeEL, infile2);

for(unsigned int i=0; i<h2; i++)

{

memcpy(cFrmBuffer1+nStart+(w1*i), cFrmBuffer2+nStart+(w1*i), w2);

}

if((err=fwrite(cFrmBuffer1, 1, nSizeEL, ofile))==0) printf("> fwrite error\r");

else printf("> %d frames were processed\r", nCurFrm++);

}

//===== finish =====

free(cFrmBuffer1);

free(cFrmBuffer2);

fclose(infile1);

fclose(infile2);

fclose(ofile);

return 0;

}

Writing DOS batch script.

hope — Thu, 14 Jul 2011 15:25:24 -0700

Sometimes you may need to write some dos script to make your experiment easy.
I recommend this web site : http://www.csie.ntu.edu.tw/~r92092/ref/win32/win32scripting.html

Updated "How to use JSVM toolkit" (JSVM tutorial)

hope — Mon, 11 Jul 2011 13:26:46 -0700

These slides were originally prepared for internal lab seminar of operating system Lab in computer science and engineering department of Korea university, and I updated some of them for general student and researcher.

July 2011.

Eun-Seok Ryu (esryu@gatech.edu)

JSVM_tutorial_Eun_Ryu.ppt

The starting point of HEVC research

hope — Fri, 17 Jun 2011 15:27:42 -0700

JCT-VC has two chairs : Jens-Rainer Ohm and Gary Sullivan.

Fraunhofer HHI leads the developing the HEVC test model (HM).
#LINK: http://hevc.info/

Currently, they provide these documents.

- JCT-VC Documents

HEVC Software repository (main at HHI)

HEVC Software repository (mirror at BBC)

HEVC Software bug tracker (at BBC)

- Documents

HEVC Reference Software Manual (JCTVC-E447)

HEVC Software Development Guidelines (JCTVC-C404)

###

Now, the document numbers were changed. Date : Oct 2011.

HEVC Reference Software Manual (JCTVC-F634)

HEVC Software Development Guidelines (JCTVC-F688)

YUV sequences repository :
#LINK: ftp://hvc:US88Hula@ftp.tnt.uni-hannover.de/testsequences

You can join the email reflector also.
#LINK: http://mailman.rwth-aachen.de/mailman/listinfo/jct-vc

In addition, I have some URL information for automatic script to test HM which was prepared for private purpose, and I cannot open them. Sorry.

HEVC YUV sequence repository

hope — Fri, 17 Jun 2011 15:15:20 -0700

NebutaFestival and SteamLocomotiveTrain sequence were added to the HEVC YUV sequences.

You can download them from this URL :
ftp://hvc:US88Hula@ftp.tnt.uni-hannover.de/testsequences

PSNR measure

hope — Wed, 01 Jun 2011 14:25:39 -0700

//This code is for measuring PSNR

double psnr( ColorComponent& rec, ColorComponent& org)

{

unsigned char* pOrg = org.data;

unsigned char* pRec = rec.data;

double ssd = 0;

int diff;

for ( int r = 0; r < rec.height; r++ )

{

for( int c = 0; c < rec.width; c++ )

{

diff = pRec[c] - pOrg[c];

ssd += (double)( diff * diff );

}

pRec += rec.width;

pOrg += org.width;

}

if( ssd == 0.0 )

{

return 99.99;

}

return ( 10.0 * log10( (double)rec.width * (double)rec.height * 65025.0 / ssd ) );

}