Advanced Professional Video

3.2.1. Arithmetic operators

• // : an integer division with rounding of the result toward zero. For example, 7//4 and -7//-4 are rounded to 1 and -7//4 and 7//-4 are rounded to -1¶

• / or div(x,y) : a division in mathematical equations where no truncation or rounding is intended¶

• % : a modulus. x % y is a remainder of x divided by y¶

• min(x,y) : the minimum value of the values x and y¶

• max(x,y) : the maximum value of the values x and y¶

• ceil(x) : the smallest integer value that is larger than or equal to x¶

• clip(x,y,z) : clip(x,y,z)=max(x,min(z,y))¶

• sum (i=x, y, f(i)) : a summation of f(i) with i taking all integer values from x up to and including y¶

• log2(x) : the base-2 lograithm of x¶

3.2.2. Bitwise operators

• & (bit-wise "and") : When operating on integer arguments, operates on a two's complement representation of the integer value. When operating on arguments with unequal bit depths, the bit depths are equalized by adding zeros in significant positions to the argument with lower bit depth.¶

• | (bit-wise "or") : When operating on integer arguments, operates on a two's complement representation of the integer value. When operating on arguments with unequal bit depths, the bit depths are equalized by adding zeros in significant positions to the argument with lower bit depth.¶

• x >> y : arithmetic right shift of a two's complement integer representation of x by y binary digits. This function is defined only for non-negative integer values of y. Bits shifted into the most significant bits (MSBs) as a result of the right shift have a value equal to the MSB of x prior to the shift operation.¶

• x << y : arithmetic left shift of a two's complement integer representation of x by y binary digits. This function is defined only for non-negative integer values of y. Bits shifted into the least significant bits (LSBs) as a result of the left shift have a value equal to 0.¶

3.3.1. Order of operations precedence

When order of precedence is not indicated explicitly by use of parentheses, operations are evaluated in the following order.¶

• Operations of a higher precedence are evaluated before any operation of a lower precedence. Table 1 specifies the precedence of operations from highest to lowest; operations closer to the top of the table indicates a higher precedence.¶

• Operations of the same precedence are evaluated sequentially from left to right.¶

4.3.1. Partitioning of a frame into tiles

This section specifies how a frame is partitioned into tiles.¶

A frame is divided into tiles. A tile is a group of MBs that cover a rectangular region of a frame and is processed independently of other tiles. Every tile has the same width and height, except possibly tiles at the right or bottom frame boundary when the frame width or height is not a multiple of the tile width or height, respectively. The tiles in a frame are scanned in raster order. Within a tile, the MBs are scanned in raster order. Each MB is comprised of one (MbWidth) x (MbHeight) luma array and zero, two, or three corresponding chroma sample arrays.¶

For example, a frame may be divided into 6 tiles (3 tile columns and 2 tile rows) as shown in Figure 3: Frame with 10 by 8 MBs that is partitioned into 6 tiles. In this example, the tile size is defined as 4 column MBs and 4 row MBs. In case of the third and sixth tiles (in raster order), the tile size is 2 column MBs and 4 row MBs since the frame width is not multiple of the tile width.¶

     +===================+===================+=========+
     #    |    |    |    # MB | MB | MB | MB # MB | MB #
     +-------------------+-------------------+---------+
     #    |    |    |    # MB | MB | MB | MB # MB | MB #
     +-----   tile  -----+-------------------+---------+
     #    |    |    |    # MB | MB | MB | MB # MB | MB #
     +-------------------+-------------------+---------+
     #    |    |    |    # MB | MB | MB | MB # MB | MB #
     +===================+===================+=========+
     # MB | MB | MB | MB # MB | MB | MB | MB # MB | MB #
     +-------------------+-------------------+---------+
     # MB | MB | MB | MB # MB | MB | MB | MB # MB | MB #
     +-------------------+-------------------+---------+
     # MB | MB | MB | MB # MB | MB | MB | MB # MB | MB #
     +-------------------+-------------------+---------+
     # MB | MB | MB | MB # MB | MB | MB | MB # MB | MB #
     +===================+===================+=========+

                 #,=  tile boundary

                 |,-  MB boundary

4.3.2. Spatial or component-wise partitioning

The following divisions of processing elements form spatial or component-wise partitioning:¶

• the division of each frame into components;¶

• the division of each frame into tile columns;¶

• the division of each frame into tile rows;¶

• the division of each tile column into tiles;¶

• the division of each tile row into tiles;¶

• the division of each tile into color components;¶

• the division of each tile into MBs;¶

• the division of each MB into blocks.¶

4.4.1. Zig-zag scan

Inputs to this process are:¶

• a variable blkWidth specifying the width of a block, and¶

• a variable blkHeight specifying the height of a block.¶

Output of this process is the array zigZagScan[sPos].¶

The array index sPos specifies the scan position ranging from 0 to (blkWidth * blkHeight)-1. Depending on the value of blkWidth and blkHeight, the array zigZagScan is derived as follows:¶

pos = 0
zigZagScan[pos] = 0
pos++
for(line = 1; line < (blkWidth + blkHeight - 1); line++){
  if(line % 2){
    x = min(line, blkWidth - 1)
    y = max(0, line - (blkWidth - 1))
    while(x >=0 && y < blkHeight){
      zigZagScan[pos] = y * blkWidth + x
      pos++
      x--
      y++
    }
  }
  else{
    y = min(line, blkHeight - 1)
    x = max(0, line - (blkHeight - 1))
    while(y >= 0 && x < blkWidth){
      zigZagScan[pos] = y * blkWidth + x
      pos++
      x++
      y--
    }
  }
}

4.4.2. Inverse scan

Inputs to this process are:¶

• a variable blkWidth specifying the width of a block, and¶

• a variable blkHeight specifying the height of a block.¶

Output of this process is the array inverseScan[rPos].¶

The array index rPos specifies the raster scan position ranging from 0 to (blkWidth * blkHeight)-1. Depending on the value of blkWidth and blkHeight, the array inverseScan is derived as follows:¶

• The variable forwardScan is derived by invoking zig-zag scan order 1D array initialization process as specified in Section 4.4.1 with input parameters blkWidth and blkHeight.¶

• The output variable inverseScan is derived as follows:¶

for(pos = 0; pos < blkWidth * blkHeight; pos++){
  inverseScan[forwardScan[pos]] = pos
}

5.2.1. byte_aligned()

• If the current position in the bitstream is on a byte boundary, i.e., the next bit in the bitstream is the first bit in a byte, the return value of byte_aligned() is equal to TRUE.¶

• Otherwise, the return value of byte_aligned() is equal to FALSE.¶

5.2.2. more_data_in_tile()

• If the current position in the tileIdx-th tile() syntax structure is less than TileSize[ tileIdx ] in bytes from the beginning of the tile_header() syntax structure of the tileIdx-th tile, the return value of more_data_in_tile() is equal to TURE.¶

• Otherwise, the return value of more_data_in_tile() is equal to FALSE.¶

5.2.3. next_bits(n)

This function provides the next bits in the bitstream for comparison purposes, without advancing the bitstream pointer. Provides a look at the next n bits in the bitstream with n being its argument.¶

5.2.4. read_bits(n)

This function indicates to read the next n bits from the bitstream and advances the bitstream pointer by n bit positions. When n is equal to 0, read_bits(n) is specified to return a value equal to 0 and to not advance the bitstream pointer.¶

5.2.5. Syntax element processing functions

• b(8): byte having any pattern of bit string (8 bits). The parsing process for this descriptor is specified by the return value of the function read_bits(8).¶

• f(n): fixed-pattern bit string using n bits written (from left to right) with the left bit first. The parsing process for this descriptor is specified by the return value of the function read_bits(n).¶

• u(n): unsigned integer using n bits. The parsing process for this descriptor is specified by the return value of the function read_bits(n) interpreted as a binary representation of an unsigned integer with most significant bit written first.¶

• h(v): variable-length entropy coded syntax element with the left bit first. The parsing process for this descriptor is specified in Section 7.1.¶

5.3.1. Access unit

syntax code                                                   | type
--------------------------------------------------------------|-----
access_unit(au_size){                                         |
    currReadSize = 0                                          |
    do(){                                                     |
        pbu_size                                              | u(32)
        currReadSize += 4                                     |
        pbu()                                                 |
        currReadSize += pbu_size                              |
    } while (au_size > currReadSize)                          |
}                                                             |

• pbu_size¶

• indicates the size of a primitive bitstream unit in bytes. The value of 0 for pbu_size is prohibited and the value of 0xFFFFFFFF for pbu_size is reserved for future use.¶

Note: An AU consists of one "primary frame", zero or more "non-primary frame"s, zero or more "alpha frame"s, zero or more "depth frame"s, zero or more "preview frame"s, zero or more "metadata"s, and zero of more "filler"s.¶

5.3.2. Primitive bitstream unit

syntax code                                                   | type
--------------------------------------------------------------|-----
pbu(){                                                        |
    pbu_header()                                              |
    if((1 <= pbu_type && pbu_type <=2) ||                     |
      (25 <= pbu_type && pbu_type <= 27))                     |
      frame()                                                 |
    else if(pbu_type == 65)                                   |
      au_info()                                               |
    else if(pbu_type == 66)                                   |
      metadata()                                              |
    else if (pbu_type == 67)                                  |
      filler()                                                |
}                                                             |

5.3.3. Primitive bitstream unit header

syntax code                                                   | type
--------------------------------------------------------------|-----
pbu_header(){                                                 |
    pbu_type                                                  | u(8)
    group_id                                                  | u(16)
    reserved_zero_8bits                                       | u(8)
}                                                             |

• pbu_type¶

• indicates the type of data in a PBU listed in Table 3. Other values of pbu_type are reserved for future use.¶

• Note: A PBU with pbu_type equal to 65 (access unit information) may happen in an AU. If it exists, it should be the first PBU in an AU, and it can be ignored by a decoder.¶

• group_id¶

• indicates the identifier to associate coded frame with metadata. More than two frame can have same group_id in a single AU. A primary frame and a non-primary frame MUST have different group_id value and two non-primary frames MUST have different group_id value. When the value of group_id is equal to 0, the value of pbu_type MUST be greater than 64. The value of 0xFFFF for group_id is reserved for future use.¶

• reserved_zero_8bits¶

• MUST be equal to 0 in bitstreams conforming to this version of document. Values of reserved_zero_8bits greater than 0 are reserved for future use. Decoders conforming to a profile specified in Section 10.1 MUST ignore PBU with values of reserved_zero_8bits greater than 0.¶

5.3.4. Frame

syntax code                                                   | type
--------------------------------------------------------------|-----
frame(){                                                      |
    frame_header()                                            |
    for(tileIdx = 0; tileIdx < NumTiles; tileIdx++){          |
        tile_size_minus1[tileIdx]                             | u(32)
        tile(tileIdx)                                         |
    }                                                         |
    filler()                                                  |
}                                                             |

• tile_size_minus1[tileIdx]¶

• plus 1 indicates the size in bytes of tileIdx-th tile data (i.e., tile(tileIdx)) in raster order in a frame.¶

• The variable TileSize[ tileIdx ] is set equal to tile_size_minus1[ tildIdx ] + 1¶

5.3.5. Frame header

syntax code                                                   | type
--------------------------------------------------------------|-----
frame_header(){                                               |
  frame_info()                                                |
  reserved_zero_8bits                                         | u(8)
  color_description_present_flag                              | u(1)
  if(color_description_present_flag){                         |
    color_primaries                                           | u(8)
    transfer_characteristics                                  | u(8)
    matrix_coefficients                                       | u(8)
  }                                                           |
  use_q_matrix                                                | u(1)
  if(use_q_matrix){                                           |
    quantization_matrix()                                     |
  }                                                           |
  tile_info()                                                 |
  reserved_zero_8bits                                         | u(8)
  byte_alignment()                                            |
}                                                             |

• reserved_zero_8bits¶

• MUST be equal to 0 in bitstreams conforming to this version of document. Values of reserved_zero_8bits greater than 0 are reserved for future use. Decoders conforming to a profile specified in Section 10.1 MUST ignore PBU with values of reserved_zero_8bits greater than 0.¶

• color_description_present_flag equal to 1¶

• specifies that color_primaries, transfer_characteristics and matrix_coefficients are present. color_description_present_flag equal to 0 specifies that color_primaries, transfer_characteristics and matrix_coefficients are not present.¶

• color_primaries¶

• MUST have the semantics of ColourPrimaries as specified in [ISO23091-2]. When the color_primaries syntax element is not present, the value of color_primaries is inferred to be equal to 2.¶

• transfer_characteristics¶

• MUST have the semantics of TransferCharacteristics as specified in [ISO23091-2]. When the transfer_characteristics syntax element is not present, the value of transfer_characteristics is inferred to be equal to 2.¶

• matrix_coefficients¶

• MUST have the semantics of MatrixCoefficients as specified in [ISO23091-2]. When the matrix_coefficients syntax element is not present, the value of matrix_coefficients is inferred to be equal to 2.¶

• use_q_matrix¶

• equal to 1 specifies that the quantization matrices are present. use_q_matrix equal to 0 specifies that the quantization matrices are not present.¶

• reserved_zero_8bits¶

• MUST be equal to 0 in bitstreams conforming to this version of document. Values of reserved_zero_8bits greater than 0 are reserved for future use. Decoders conforming to a profile specified in Section 10.1 MUST ignore PBU with values of reserved_zero_8bits greater than 0.¶

5.3.6. Frame information

syntax code                                                   | type
--------------------------------------------------------------|-----
frame_info(){                                                 |
  profile_idc                                                 | u(8)
  level_idc                                                   | u(8)
  band_idc                                                    | u(3)
  reserved_zero_5bits                                         | u(5)
  frame_width_minus1                                          | u(32)
  frame_height_minus1                                         | u(32)
  chroma_format_idc                                           | u(4)
  bit_depth_minus8                                            | u(4)
  capture_time_distance                                       | u(8)
  reserved_zero_8bits                                         | u(8)
}                                                             |

• profile_idc¶

• indicates a profile to which the coded frame conforms to as specified in Section 10.1. Bitstreams shall not contain values of profiles_idc other than those specified in Section 10.1. Other values of profile_idc are reserved for future use.¶

• level_idc¶

• indicates a level to which the coded frame conforms to as specified in Section 10.1. Bitstreams shall not contain values of level_idc other than those specified in Section 10.1. Other values of level_idc are reserved for future use.¶

• band_idc¶

• specifies a maximum coded data rate of level_idc as specified in Section 10.1. Bitstreams shall not contain values of band_idc other than those specified in Section 10.1. The value of band_idc MUST be in the range of 0 to 3. Other values of band_idc are reserved for future use.¶

• reserved_zero_5bits¶

• shall be equal to 0 in bitstreams conforming to this version of document. Values of reserved_zero_5bits greater than 0 are reserved for future use. Decoders conforming to a profile specified in Section 10.1. MUST ignore PBU with values of reserved_zero_5bits greater than 0.¶

• frame_width_minus1¶

• plus 1 specifies the width of frame in units of luma samples. frame_width_minus1 plus 1 MUST be as multiple of 2 when chroma_format_idc has a value of 2.¶

• frame_height_minus1¶

• plus 1 specifies the height of frame in units of luma samples.¶

• The variables FrameWidthInMbsY, FrameHeightInMbsY, FrameWidthInSamplesY, FrameHeightInSamplesY, FrameWidthInSamplesC, FrameHeightInSamplesC, FrameSizeInMbsY, and FrameSizeInSamplesY are derived as follows:¶

• • FrameWidthInSamplesY = frame_width_minus1 + 1¶

  • FrameHeightInSamplesY = frame_height_minus1 + 1¶

  • FrameWidthInMbsY = ceil(FrameWidthInSamplesY / MbWidth)¶

  • FrameHeightInMbsY = ceil(FrameHeightInSamplesY / MbHeight)¶

  • FrameWidthInSamplesC = FrameWidthInSamplesY // SubWidthC¶

  • FrameHeightInSamplesC = FrameHeightInSamplesY // SubHeightC¶

  • FrameSizeInMbsY = FrameWidthInMbsY * FrameHeightInMbsY¶

  • FrameSizeInSamplesY = FrameWidthInSamplesY * FrameHeightInSamplesY¶

• chroma_format_idc¶

• specifies the chroma sampling relative to the luma sampling as specified in Table 2 The value of chroma_format_idc MUST be 0, 2, 3, or 4. Other values of chroma_format_idc are reserved for future use.¶

• bit_depth_minus8¶

• specifies the bit depth of the samples. The variables BitDepth and QpBdOffset are derived as follows:¶

• • • BitDepth = bit_depth_minus8 + 8¶

• • • QpBdOffset = bit_depth_minus8 * 6¶

• bit_depth_minus8¶

• MUST be in the range of 2 to 8, inclusive. Other values of bit_depth_minus8 are reserved for future use.¶

• capture_time_distance¶

• indicates time difference between the capture time of the previous frame and the current frame if there has been any frame preceding this frame.¶

• reserved_zero_8bits¶

• MUST be equal to 0 in bitstreams conforming to this version of document. Values of reserved_zero_8bits greater than 0 are reserved for future use. Decoders conforming to a profile specified in Section 10.1 MUST ignore PBU with values of reserved_zero_8bits greater than 0.¶

5.3.7. Quantization matrix

syntax code                                                   | type
--------------------------------------------------------------|-----
quantization_matrix(){                                        |
  for(cIdx = 0; cIdx < NumComp; cIdx++){                      |
    for(y = 0; y < 8; y++){                                   |
      for(x = 0; x < 8; x++){                                 |
        q_matrix_minus1[cIdx][x][y]                           | u(8)
      }                                                       |
    }                                                         |
  }                                                           |
}                                                             |

• q_matrix_minus1[cIdx][x0][y0]¶

• plus 1 specifies a scaling value in the quantization matrices. When q_matrix_minus1[cIdx][x0][y0] is not present, it is inferred to be equal to 15. The array index cIdx specifies an indicator for the color component; when chroma_format_idc is equal to 2 or 3, 0 for Y, 1 for Cb and 2 for Cr.¶

• The quantization matrix, QMatrix[cIdx][x0][y0], is derived as follows:¶

• QMatrix[cIdx][x0][y0] = q_matrix_minus1[cIdx][x0][y0] + 1¶

5.3.8. Tile info

syntax code                                                   | type
--------------------------------------------------------------|-----
tile_info(){                                                  |
  tile_width_in_mbs_minus1                                    | u(28)
  tile_height_in_mbs_minus1                                   | u(28)
  startMb=0                                                   |
  for(i = 0; startMb < FrameWidthInMbsY; i++){                |
    ColStarts[i] = startMb * MbWidth                          |
    startMb += tile_width_in_mbs_minus1 + 1                   |
  }                                                           |
  ColStarts[i] = FrameWidthInMbsY*MbWidth                     |
  TileCols = i                                                |
  startMb = 0                                                 |
  for(i = 0; startMb < FrameHeightMbsY; i++){                 |
    RowStarts[i] = startMb * MbHeight                         |
    startMb += tile_height_in_mbs_minus1 + 1                  |
  }                                                           |
  RowStarts[i] = FrameHeightMbsY*MbHeight                     |
  TileRows = i                                                |
  NumTiles = TileCols * TileRows                              |
  tile_size_present_in_fh_flag                                | u(1)
  if(tile_size_present_in_fh_flag){                           |
    for(tileIdx = 0; tileIdx < NumTiles; tileIdx++){          |
      tile_size_in_fh_minus1[tileIdx]                         | u(32)
    }                                                         |
  }                                                           |
}                                                             |

• tile_width_in_mbs_minus1¶

• plus 1 specifies the width of a tile in units of MBs.¶

• tile_height_in_mbs_minus1¶

• plus 1 specifies the height of a tile in units of MBs.¶

• tile_size_present_in_fh_flag¶

• equal to 1 specifies that tile_size_in_fh_minus1[tileIdx] is present in Frame header. tile_size_present_in_fh_flag equal to 0 specifies that tile_size_in_fh_minus1[tileIdx] is not present in Frame header.¶

• tile_size_in_fh_minus1[tileIdx]¶

• plus 1 indicates the size in bytes of tileIdx-th tile data in raster order in a frame. The value of tile_size_in_fh_minus1[tileIdx] MUST have the same value with tile_size_minus[tileIdx]. When it is not present, the value of tile_size_in_fh_minus1[tileIdx] is inferred to be equal to tile_size_minus1[tileIdx].¶

5.3.9. Access unit information

syntax code                                                   | type
--------------------------------------------------------------|-----
au_info(){                                                    |
  num_frames                                                  | u(16)
  for(idx = 0; idx < num_frames; idx++){                      |
    pbu_type                                                  | u(8)
    group_id                                                  | u(16)
    reserved_zero_8bits                                       | u(8)
    frame_info()                                              |
  }                                                           |
  reserved_zero_8bits                                         | u(8)
  byte_alignment()                                            |
}                                                             |

• num_frames¶

• indicates the number of frames contained in the current AU.¶

• pbu_type¶

• has the same semantics as pbu_type in the pbu_header() syntax. Note: The value of pbu_type MUST be 1, 2, 25, 26, or 27 in bitstreams conforming to this version of document.¶

• group_id¶

• has the same semantics as group_id in the pbu_header() syntax.¶

• reserved_zero_8bits¶

• MUST be equal to 0 in bitstreams conforming to this version of document. Values of reserved_zero_8bits greater than 0 are reserved for future use. Decoders conforming to a profile specified in Section 10.1 MUST ignore PBU with values of reserved_zero_8bits greater than 0.¶

5.3.10. Metadata

syntax code                                                   | type
--------------------------------------------------------------|-----
metadata(){                                                   |
  metadata_size                                               | u(32)
  currReadSize = 0                                            |
  do{                                                         |
    payloadType = 0                                           |
    while(next_bits(8) == 0xFF){                              |
      ff_byte                                                 | f(8)
      payloadType += ff_byte                                  |
      currReadSize++                                          |
    }                                                         |
    metadata_payload_type                                     | u(8)
    payloadType += metadata_payload_type                      |
    currReadSize++                                            |
                                                              |
    payloadSize = 0                                           |
    while(next_bits(8) == 0xFF){                              |
      ff_byte                                                 | f(8)
      payloadSize += ff_byte                                  |
      currReadSize++                                          |
    }                                                         |
    metadata_payload_size                                     | u(8)
    payloadSize += metadata_payload_size                      |
    currReadSize++                                            |
                                                              |
    metadata_payload(payloadType, payloadSize)                |
    currReadSize += payloadSize                               |
  } while(metadata_size > currReadSize)                       |
  filler()                                                    |
}                                                             |

• metadata_size¶

• specifies the size of metadata before filler() in the current PBU.¶

• ff_byte¶

• is a byte equal to 0xFF.¶

• metadata_payload_type¶

• specifies the last byte of the payload type of a metadata¶

• metadata_payload_size¶

• specifies the last byte of the payload size of a metadata¶

Syntax and semantics of metadata_payload() are specified in Section 10.3.¶

5.3.11. Filler

syntax code                                                   | type
--------------------------------------------------------------|-----
filler(){                                                     |
  while(next_bits(8) == 0xFF)                                 |
    ff_byte                                                   | f(8)
}                                                             |

• ff_byte¶

• is a byte equal to 0xFF.¶

5.3.12. Tile

syntax code                                                   | type
--------------------------------------------------------------|-----
tile(tileIdx){                                                |
  tile_header()                                               |
  for(i = 0; i < NumComp; i++){                               |
    tile_data(tileIdx, i)                                     |
  }                                                           |
  while(more_data_in_tile()){                                 |
    tile_dummy_byte                                           | b(8)
  }                                                           |
}                                                             |

• tile_dummy_byte¶

• has any pattern of 8-bit string.¶

5.3.13. Tile header

syntax code                                                   | type
--------------------------------------------------------------|-----
tile_header(){                                                |
  tile_header_size                                            | u(16)
  tile_index                                                  | u(16)
  for(i = 0; i < NumComp; i++){                               |
    tile_data_size_minus1[i]                                  | u(32)
  }                                                           |
  for(i = 0; i < NumComp; i++){                               |
    tile_qp[i]                                                | u(8)
  }                                                           |
  reserved_zero_8bits                                         | u(8)
  byte_alignment()                                            |
}                                                             |

• tile_header_size¶

• indicates the size of the tile header in bytes.¶

• tile_index¶

• specifies the tile index in raster order in a frame. tile_index MUST have the same value with tileIdx.¶

• tile_data_size_minus1[i]¶

• plus 1 indicates the size of i-th color component data in a tile in bytes. The array index i specifies an indicator for the color component; when chroma_format_idc is equal to 2 or 3, 0 for Y, 1 for Cb and 2 for Cr¶

• tile_qp[i]¶

• specify the quantization parameter value for i-th color component. The array index i specifies an indicator for the color component; when chroma_format_idc is equal to 2 or 3, 0 for Y, 1 for Cb and 2 for Cr. Qp[i] to be used for the MBs in the tile are derived as follows¶

• • • Qp[i] = tile_qp[i] - QpBdOffset¶

• • • Qp[i] MUST be in the range of -QpBdOffset to 51, inclusive.¶

• reserved_zero_8bits¶

• MUST be equal to 0 in bitstreams conforming to this version of document. Values of reserved_zero_8bits greater than 0 are reserved for future use. Decoders conforming to a profile specified in Section 10.1 MUST ignore PBU with values of reserved_zero_8bits greater than 0.¶

5.3.14. Tile data

syntax code                                                   | type
--------------------------------------------------------------|-----
tile_data(tileIdx, cIdx){                                     |
  x0 = ColStarts[tileIdx % TileCols]                          |
  y0 = RowStarts[tileIdx // TileCols]                         |
  numMbColsInTile = (ColStarts[tileIdx % TileCols + 1] -      |
          ColStarts[tileIdx % TileCols]) // MbWidth           |
  numMbRowsInTile = (RowStarts[tileIdx // TileCols + 1] -     |
          RowStarts[tileIdx // TileCols]) // MbHeight         |
  numMbsInTile = numMbColsInTile * numMbRowsInTile            |
  PrevDC = 0                                                  |
  PrevDcDiff = 20                                             |
  Prev1stAcLevel = 0                                          |
  for(i = 0; i < numMbsInTile; i++){                          |
    xMb = x0 + ((i % numMbColsInTile) * MbWidth)              |
    yMb = y0 + ((i // numMbColsInTile) * MbHeight)            |
    macroblock_layer(xMb, yMb, cIdx)                          |
  }                                                           |
  byte_alignment()                                            |
}                                                             |

5.3.15. Macroblock layer

syntax code                                                   | type
--------------------------------------------------------------|-----
macroblock_layer(xMb, yMb, cIdx){                             |
  subW = (cIdx == 0)? 1 : SubWidthC                           |
  subH = (cIdx == 0)? 1 : SubHeightC                          |
  blkWidth = (cIdx == 0)? MbWidth : MbWidthC                  |
  blkHeight = (cIdx == 0)? MbHeight : MbHeightC               |
  TrSize = 8                                                  |
  for(y = 0; y < blkHeight; y += TrSize){                     |
    for(x = 0; x < blkWidth; x += TrSize){                    |
      abs_dc_coeff_diff                                       | h(v)
      if(abs_dc_coeff_diff)                                   |
        sign_dc_coeff_diff                                    | u(1)
      TransCoeff[cIdx][xMb // subW + x][yMb // subH + y] =    |
            PrevDC + abs_dc_coeff_diff *                      |
            (1 - 2*sign_dc_coeff_diff)                        |
      PrevDC =                                                |
        TransCoeff[cIdx][xMb // subW + x][yMb // subH + y]    |
      PrevDcDiff = abs_dc_coeff_diff                          |
      ac_coeff_coding(xMb // subW + x, yMb // subH + y,       |
            log2(TrSize), log2(TrSize), cIdx)                 |
    }                                                         |
  }                                                           |
}                                                             |

• abs_dc_coeff_diff¶

• specifies the absolute value of the difference between the current DC transform coefficient level and PrevDC.¶

• sign_dc_coeff_diff¶

• specifies the sign of the difference between the current DC transform coefficient level and PrevDC. sign_dc_coeff_diff equal to 0 specifies that the difference has a positive value. sign_dc_coeff_diff equal to 1 specifies that the difference has a negative value.¶

The transform coefficients are represented by the arrays TransCoeff[cIdx][x0][y0]. The array indices x0, y0 specify the location (x0, y0) relative to the top-left sample for each component of the frame. The array index cIdx specifies an indicator for the color component; when chroma_format_idc is equal to 2 or 3, 0 for Y, 1 for Cb and 2 for Cr. The value of TransCoeff[cIdx][x0][y0] MUST be in the range of -32768 to 32767, inclusive.¶

5.3.16. AC coefficient coding

syntax code                                                   | type
--------------------------------------------------------------|-----
ac_coeff_coding(x0, y0, log2BlkWidth, log2BlkHeight, cIdx){   |
  scanPos = 1                                                 |
  firstAC = 1                                                 |
  PrevLevel = Prev1stAcLevel                                  |
  PrevRun = 0                                                 |
  do{                                                         |
    coeff_zero_run                                            | h(v)
    for(i = 0; i < coeff_zero_run; i++){                      |
      blkPos = ScanOrder[scanPos]                             |
      xC = blkPos & ((1 << log2BlkWidth) - 1)                 |
      yC = blkPos >> log2BlkWidth                             |
      TransCoeff[cIdx][x0+xC][y0 + yC] = 0                    |
      scanPos++                                               |
    }                                                         |
    PrevRun = coeff_zero_run                                  |
    if(scanPos < (1 << (log2BlkWidth + log2BlkHeight))){      |
      abs_ac_coeff_minus1                                     | h(v)
      sign_ac_coeff                                           | u(1)
      level = (abs_ac_coeff_minus1 + 1) *                     |
        (1 - 2 * sign_ac_coeff)                               |
      blkPos = ScanOrder[scanPos]                             |
      xC = blkPos & ((1 << log2BlkWidth) - 1)                 |
      yC = blkPos >> log2BlkWidth                             |
      TransCoeff[cIdx][x0 + xC][y0 + yC] = level              |
      scanPos++                                               |
      PrevLevel = abs_ac_coeff_minus1 + 1                     |
      if(firstAC == 1){                                       |
        firstAC = 0                                           |
        Prev1stAcLevel = PrevLevel                            |
      }                                                       |
    }                                                         |
  } while(scanPos < (1 << (log2BlkWidth + log2BlkHeight)))    |
}                                                             |

• coeff_zero_run¶

• specifies the number of zero-valued transform coefficient levels that are located before the position of the next non-zero transform coefficient level in a scan of transform coefficient levels.¶

• abs_ac_coeff_minus1¶

• plus 1 specifies the absolute value of an AC transform coefficient level at the given scanning position.¶

• sign_ac_coeff¶

• specifies the sign of an AC transform coefficient level for the given scanning position. sign_ac_coeff equal to 0 specifies that the corresponding AC transform coefficient level has a positive value. sign_ac_coeff equal to 1 specifies that the corresponding AC transform coefficient level has a negative value.¶

The array ScanOrder[sPos] specifies the mapping of the zig-zag scan position sPos, ranging from 0 to (1 << log2BlkWidth) * (1 << log2BlkHeight) - 1, inclusive, to a raster scan position rPos. ScanOrder is derived by invoking Section 4.4.1 with input parameters blkWidth equal to (1 << log2BlkWidth) and blkHeight equal to (1 << log2BlkHeight).¶

5.3.17. Byte alignment

syntax code                                                   | type
--------------------------------------------------------------|-----
byte_alignment(){                                             |
  while(!byte_aligned())                                      |
    alignment_bit_equal_to_zero                               | f(1)
}                                                             |

• alignment_bit_equal_to_zero¶

• MUST be equal to 0.¶

6.3.1. Scaling process for transform coefficients

Inputs to this process are:¶

• a location (xBlkY, yBlkY) of the current color component specifying the top-left sample of the current block relative to the top-left sample of the current frame,¶

• a variable nBlkW specifying the width of the current block,¶

• a variable nBlkH specifying the height of the current block,¶

• a variable cIdx specifying the color component of the current block, and¶

• a variable qP specifying the quantization parameter.¶

Output of this process is the (nBlkW)x(nBlkH) array d of scaled transform coefficients with elements d[x][y].¶

The variable bdShift is derived as follows:¶

• • bdShift = BitDepth + ((log2(nBlkW) + log2(nBlkH)) // 2) - 5¶

The list levelScale[] is specified as follows:¶

• • levelScale[k] = {40, 45, 51, 57, 64, 71} with k = 0..5.¶

For the derivation of the scaled transform coefficients d[x][y] with x = 0..nBlkW - 1, y = 0..nBlkH - 1, the following applies:¶

• The scaled transform coefficient d[x][y] is derived as follows:¶

• • d[x][y] = clip(-32768, 32767, ((TransCoeff[cIdx][xBlkY][yBlkY] * QMatrix[cIdx][x][y] * levelScale[qP % 6] << (qP//6)) + (1 << (bdShift-1)) >> bdShift))¶

6.3.2. Process for scaled transform coefficients

transMatrix[m][n] =
   {
    {  64,  64,  64,  64,  64,  64,  64,  64 }
    {  89,  75,  50,  18, -18, -50, -75, -89 }
    {  84,  35, -35, -84, -84, -35,  35,  84 }
    {  75, -18, -89, -50,  50,  89,  18, -75 }
    {  64, -64, -64,  64,  64, -64, -64,  64 }
    {  50, -89,  18,  75, -75, -18,  89, -50 }
    {  35, -84,  84, -35, -35,  84, -84,  35 }
    {  18, -50,  75, -89,  89, -75,  50, -18 }
   }

7.1.1. Process for abs_dc_coeff_diff

Inputs to this process are bits for the abs_dc_coeff_diff syntax element. Output of this process is a value of the abs_dc_coeff_diff syntax element. The variable kParam is derived as follows:¶

• • kParam = clip(0, 5, PrevDcDiff >> 1)¶

The value of syntax element abs_dc_coeff_diff is obtained by invoking the parsing process for variable length codes as specified in Section 7.1.4 with kParam.¶

7.1.2. Process for coeff_zero_run

Inputs to this process are bits for the coeff_zero_run syntax element.¶

Output of this process is a value of the coeff_zero_run syntax element.¶

The variable kParam is derived as follows:¶

• • kParam = clip(0, 2, PrevRun >> 2)¶

The value of syntax element coeff_zero_run is obtained by invoking the parsing process for variable length codes as specified in Section 7.1.4 with kParam.¶

7.1.3. Process for abs_ac_coeff_minus1

Inputs to this process are bits for the abs_ac_coeff_minus1 syntax element.¶

Output of this process is a value of the abs_ac_coeff_minus1 syntax element.¶

The variable kParam is derived as follows:¶

• • kParam = clip(0, 4, PrevLevel >> 2)¶

The value of syntax element abs_ac_coeff_minus1 is obtained by invoking the parsing process for variable length codes as specified in Section 7.1.4 with kParam.¶

7.1.4. Process for variable length codes

Input to this process is kParam.¶

Output of this process is a value, symbolValue, of a syntax element.¶

The symbolValue is derived as follows:¶

symbolValue = 0
parseExpGolomb = 1
k = kParam
stopLoop = 0

if(read_bits(1) == 1){
  parseExpGolomb = 0
}
else{
  if(read_bits (1) == 0){
    symbolValue += (1 << k)
    parseExpGolomb = 0
  }
  else{
    symbolValue += (2 << k)
    parseExpGolomb = 1
  }
}

if(parseExpGolomb){
  do{
    if(read_bits(1) == 1){
      stopLoop = 1
    }
    else{
      symbolValue += (1 << k)
      k++
    }
  } while(!stopLoop)
}

if(k > 0)
  symbolValue += read_bits(k)

where the value returned from read_bits(n) is interpreted as a binary representation of a n-bit unsigned integer with most significant bit written first.¶

7.2.1. Process for abs_dc_coeff_diff

Input to this process is a symbol value of the abs_dc_coeff_diff syntax element.¶

Output of this process is a codeword of the abs_dc_coeff_diff syntax element.¶

The variable kParam is derived as follows:¶

• • kParam = clip(0, 5, PrevDcDiff >> 1)¶

The codeword of syntax element abs_dc_coeff_diff is obtained by invoking the generation process for variable length codes as specified in Section 7.2.4 with the symbol value symbolValue and kParam.¶

7.2.2. Process for coeff_zero_run

Input to this process is a symbol value of the coeff_zero_run syntax element.¶

Output of this process is a codeword of the coeff_zero_run syntax element.¶

The variable kParam is derived as follows:¶

• • kParam = clip(0, 2, PrevRun >> 2)¶

The codeword of syntax element coeff_zero_run is obtained by invoking the generation process for variable length codes as specified in Section 7.2.4 with the symbol value symbolValue and kParam.¶

7.2.3. Process for abs_ac_coeff_minus1

Input to this process is a symbol value of the abs_ac_coeff_minus1 syntax element.¶

Output of this process is a codeword of the abs_ac_coeff_minus1 syntax element.¶

The variable kParam is derived as follows:¶

• • kParam = clip(0, 4, PrevLevel >> 2)¶

The codeword of syntax element abs_ac_coeff_minus1 is obtained by invoking the generation for variable length codes as specified in Section 7.2.4 with the symbol value symbolValue and kParam.¶

7.2.4. Process for variable length codes

Inputs to this process are symbolVal and kParam¶

Output of this process is a codeword of a syntax element.¶

The codeword is derived as follows:¶

PrefixVLCTable[3][2] = {{1, 0}, {0, 0}, {0, 1}}

symbolValue = symbolVal
valPrefixVLC = clip(0, 2, symbolVal >> kParam)
bitCount = 0
k = kParam

while(symbolValue >= (1 << k)){
  symbolValue -= (1 << k)
  if(bitCount < 2)
    put_bits(PrefixVLCTable[valPrefixVLC][bitCount], 1)
  else
    put_bits(0, 1)
  if(bitCount >= 2)
    k++
  bitCount++
}

if(bitCount < 2)
  put_bits(PrefixVLCTable[valPrefixVLC][bitCount], 1)
else
  put_bits(1, 1)

if(k > 0)
  put_bits(symbolValue, k)

where a codeword generated from put_bits(v, n) is interpreted as a binary representation of an n-bit unsigned integer value v with most significant bit written first.¶

10.1.1. Overview of profiles, levels, and bands

Profiles, levels and bands specify restrictions on a coded frame and hence limits on the capabilities needed to decode the coded frame. Profiles, levels and bands may also be used to indicate interoperability points between individual decoder implementations.¶

• NOTE: This document does not include individually selectable "options" at the decoder, as this would increase interoperability difficulties. Each profile specifies a subset of algorithmic features and limits that MUST be supported by all decoders conforming to that profile.¶

• NOTE: Encoders are not required to make use of any particular subset of features supported in a profile.¶

Each level with a band specifies a set of limits on the values that may be taken by the syntax elements of this document. The same set of level and band definitions is used with all profiles, but individual implementations may support a different level for each supported profile. For any given profile, a level with a band generally corresponds to a particular decoder processing load and memory capability.¶

10.1.2. Requirements on video decoder capability

Capabilities of video decoders conforming to this document are specified in terms of the ability to decode video streams conforming to the constraints of profiles, levels and bands specified in this section. When expressing the capabilities of a decoder for a specified profile, the level and the band supported for that profile should also be expressed.¶

Specific values are specified in this section for the syntax elements profile_idc, level_idc and band_idc. All other values of profile_idc, level_idc and band_idc are reserved for future use.¶

• NOTE: Decoders must not infer that a reserved value of profile_idc between the values specified in this document indicates intermediate capabilities between the specified profiles, as there are no restrictions on the method to be chosen for the use of such future reserved values. However, decoders must infer that a reserved value of level_idc and a reserved value of band_idc between the values specified in this document indicates intermediate capabilities between the specified levels.¶

10.1.3. Profiles

10.1.4. Levels and bands

10.3.1. Metadata payload syntax

syntax code                                                   | type
--------------------------------------------------------------|-----
metadata_payload(payloadType, payloadSize){                   |
  if(payloadType == 4){                                       |
    metadata_itu_t_t35(payloadSize)                           |
  }                                                           |
  else if(payloadType == 5){                                  |
    metadata_mdcv(payloadSize)                                |
  }                                                           |
  else if(payloadType == 6){                                  |
    metadata_cll(payloadSize)                                 |
  }                                                           |
  else if(payloadType == 10){                                 |
    metadata_filler(payloadSize)                              |
  }                                                           |
  else if(payloadType == 170){                                |
    metadata_user_defined(payloadSize)                        |
  }                                                           |
  else{                                                       |
    metadata_undefined(payloadSize)                           |
  }                                                           |
  byte_alignment()                                            |
}                                                             |

10.3.2. Filler metadata

syntax code                                                   | type
--------------------------------------------------------------|-----
metadata_filler(payloadSize){                                 |
  for(i = 0; i < payloadSize; i++){                           |
    ff_byte                                                   | f(8)
  }                                                           |
}                                                             |

• ff_byte¶

• is a byte equal to 0xFF.¶

10.3.3. Recommendation ITU-T T.35 metadata

This metadata contains information registered as specified in [ITUT-T35].¶

syntax code                                                   | type
--------------------------------------------------------------|-----
metadata_itu_t_t35(payloadSize){                              |
  itu_t_t35_country_code                                      | b(8)
  readSize = payloadSize - 1                                  |
                                                              |
  if(itu_t_t35_country_code == 0xFF){                         |
    itu_t_t35_country_code_extension                          | b(8)
    readSize--                                                |
  }                                                           |
                                                              |
  while (readSize > 0){                                       |
    itu_t_t35_payload                                         | b(8)
    readSize--                                                |
  }                                                           |
}                                                             |

• itu_t_t35_country_code¶

• MUST be a byte having the semantics of country code as specified in Annex A of [ITUT-T35].¶

• itu_t_t35_country_code_extension¶

• MUST be a byte having the semantics of country code as specified in Annex B of [ITUT-T35].¶

• itu_t_t35_payload¶

• MUST be bytes having the semantics of data registered as specified in [ITUT-T35].¶

The terminal provider code and terminal provider oriented code as specified in [ITUT-T35] shall be contained in the first one or more bytes of the itu_t_t35_payload. Any remaining bytes in itu_t_t35_payload data shall be data having syntax and semantics as specified by the entity identified by the [ITUT-T35] country code and terminal provider code.¶

10.3.4. Mastering display color volume metadata

syntax code                                                   | type
--------------------------------------------------------------|-----
metadata_mdcv(payloadSize){                                   |
  for(i = 0; i < 3; i+ + ) {                                  |
    primary_chromaticity_x[i]                                 | u(16)
    primary_chromaticity_y[i]                                 | u(16)
  }                                                           |
  white_point_chromaticity_x                                  | u(16)
  white_point_chromaticity_y                                  | u(16)
  max_mastering_luminance                                     | u(32)
  min_mastering_luminance                                     | u(32)
}                                                             |

• primary_chromaticity_x[i]¶

• specifies a 0.16 fixed-point format of X chromaticity coordinate of mastering display as defined by CIE 1931, where i = 0, 1, 2 specifies Red, Green, Blue respectively.¶

• primary_chromaticity_y[i]¶

• specifies a 0.16 fixed-point format of Y chromaticity coordinate of mastering display as defined by CIE 1931, where i = 0, 1, 2 specifies Red, Green, Blue respectively.¶

• white_point_chromaticity_x¶

• specifies a 0.16 fixed-point format of white point X chromaticity coordinate of mastering display as defined by CIE 1931.¶

• white_point_chromaticity_y¶

• specifies a 0.16 fixed-point format of white point Y chromaticity coordinate as mastering display defined by CIE 1931.¶

• max_mastering_luminance¶

• is a 24.8 fixed-point format of maximum display mastering luminance, represented in candelas per square meter.¶

• min_mastering_luminance¶

• is a 18.14 fixed-point format of minimum display mastering luminance, represented in candelas per square meter.¶

10.3.5. Content light level information metadata

syntax code                                                   | type
--------------------------------------------------------------|-----
metadata_cll(payloadSize){                                    |
  max_cll                                                     | u(16)
  max_fall                                                    | u(16)
}                                                             |

• max_cll¶

• specifies the maximum content light level information as specified in [CEA-861.3], Appendix A.¶

• max_fall¶

• specifies the maximum frame-average light level information as specified in [CEA-861.3], Appendix A.¶

10.3.6. User defined metadata syntax and semantics

This metadata has user data identified by a universal unique identifier as specifies in [ISO11578], the contents of which are not specified in this document.¶

syntax code                                                 | type
------------------------------------------------------------|-----
metadata_user_defined(payloadSize){                         |
  uuid                                                      | u(128)
  for(i = 0; i < (payloadSize - 16); i++)                   |
    user_defined_data_payload                               | b(8)
}                                                           |

• uuid¶

• MUST be a 128-bit value specified as a generated UUID according to the procedures of [ISO11578] Annex A.¶

• user_defined_data_payload¶

• MUST be a byte having user defined syntax and semantics as specified by the UUID generator.¶

10.3.7. Undefined metadata syntax and semantics

syntax code                                                   | type
--------------------------------------------------------------|-----
metadata_undefined(payloadSize){                              |
  for(i = 0; i < payloadSize; i++){                           |
    undefined_metadata_payload_byte                           | b(8)
  }                                                           |
}                                                             |

• undefined_metadata_payload_byte¶

• is a byte reserved for future case.¶