Examples of Bidi

com.ibm.icu.text.Bidi

nicode.org/unicode/reports/tr9/">Unicode Standard Annex #9, version 13, also described in The Unicode Standard, Version 4.0 .

Note: Libraries that perform a bidirectional algorithm and reorder strings accordingly are sometimes called "Storage Layout Engines". ICU's Bidi and shaping (ArabicShaping) classes can be used at the core of such "Storage Layout Engines".

General remarks about the API:

The "limit" of a sequence of characters is the position just after their last character, i.e., one more than that position.

Some of the API methods provide access to "runs". Such a "run" is defined as a sequence of characters that are at the same embedding level after performing the Bidi algorithm.

Basic concept: paragraph

A piece of text can be divided into several paragraphs by characters with the Bidi class Block Separator. For handling of paragraphs, see:

{@link #countParagraphs}
{@link #getParaLevel}
{@link #getParagraph}
{@link #getParagraphByIndex}

Basic concept: text direction

The direction of a piece of text may be:

{@link #LTR}
{@link #RTL}
{@link #MIXED}

Basic concept: levels

Levels in this API represent embedding levels according to the Unicode Bidirectional Algorithm. Their low-order bit (even/odd value) indicates the visual direction.

Levels can be abstract values when used for the paraLevel and embeddingLevels arguments of setPara(); there:

the high-order bit of an embeddingLevels[] value indicates whether the using application is specifying the level of a character to override whatever the Bidi implementation would resolve it to.
paraLevel can be set to the pseudo-level values LEVEL_DEFAULT_LTR and LEVEL_DEFAULT_RTL.

The related constants are not real, valid level values. DEFAULT_XXX can be used to specify a default for the paragraph level for when the setPara() method shall determine it but there is no strongly typed character in the input.

Note that the value for LEVEL_DEFAULT_LTR is even and the one for LEVEL_DEFAULT_RTL is odd, just like with normal LTR and RTL level values - these special values are designed that way. Also, the implementation assumes that MAX_EXPLICIT_LEVEL is odd.

See Also:

{@link #LEVEL_DEFAULT_LTR}
{@link #LEVEL_DEFAULT_RTL}
{@link #LEVEL_OVERRIDE}
{@link #MAX_EXPLICIT_LEVEL}
{@link #setPara}

Basic concept: Reordering Mode

Reordering mode values indicate which variant of the Bidi algorithm to use.

See Also:

{@link #setReorderingMode}
{@link #REORDER_DEFAULT}
{@link #REORDER_NUMBERS_SPECIAL}
{@link #REORDER_GROUP_NUMBERS_WITH_R}
{@link #REORDER_RUNS_ONLY}
{@link #REORDER_INVERSE_NUMBERS_AS_L}
{@link #REORDER_INVERSE_LIKE_DIRECT}
{@link #REORDER_INVERSE_FOR_NUMBERS_SPECIAL}

Basic concept: Reordering Options

Reordering options can be applied during Bidi text transformations.

See Also:

{@link #setReorderingOptions}
{@link #OPTION_DEFAULT}
{@link #OPTION_INSERT_MARKS}
{@link #OPTION_REMOVE_CONTROLS}
{@link #OPTION_STREAMING}

@author Simon Montagu, Matitiahu Allouche (ported from C code written by Markus W. Scherer) @stable ICU 3.8

Sample code for the ICU Bidi API

Rendering a paragraph with the ICU Bidi API

This is (hypothetical) sample code that illustrates how the ICU Bidi API could be used to render a paragraph of text. Rendering code depends highly on the graphics system, therefore this sample code must make a lot of assumptions, which may or may not match any existing graphics system's properties.

The basic assumptions are:

Rendering is done from left to right on a horizontal line.
A run of single-style, unidirectional text can be rendered at once.
Such a run of text is passed to the graphics system with characters (code units) in logical order.
The line-breaking algorithm is very complicated and Locale-dependent - and therefore its implementation omitted from this sample code.

 package com.ibm.icu.dev.test.bidi; import com.ibm.icu.text.Bidi; import com.ibm.icu.text.BidiRun; public class Sample { static final int styleNormal = 0; static final int styleSelected = 1; static final int styleBold = 2; static final int styleItalics = 4; static final int styleSuper=8; static final int styleSub = 16; static class StyleRun { int limit; int style; public StyleRun(int limit, int style) { this.limit = limit; this.style = style; } } static class Bounds { int start; int limit; public Bounds(int start, int limit) { this.start = start; this.limit = limit; } } static int getTextWidth(String text, int start, int limit, StyleRun[] styleRuns, int styleRunCount) { // simplistic way to compute the width return limit - start; } // set limit and StyleRun limit for a line // from text[start] and from styleRuns[styleRunStart] // using Bidi.getLogicalRun(...) // returns line width static int getLineBreak(String text, Bounds line, Bidi para, StyleRun styleRuns[], Bounds styleRun) { // dummy return return 0; } // render runs on a line sequentially, always from left to right // prepare rendering a new line static void startLine(byte textDirection, int lineWidth) { System.out.println(); } // render a run of text and advance to the right by the run width // the text[start..limit-1] is always in logical order static void renderRun(String text, int start, int limit, byte textDirection, int style) { } // We could compute a cross-product // from the style runs with the directional runs // and then reorder it. // Instead, here we iterate over each run type // and render the intersections - // with shortcuts in simple (and common) cases. // renderParagraph() is the main function. // render a directional run with // (possibly) multiple style runs intersecting with it static void renderDirectionalRun(String text, int start, int limit, byte direction, StyleRun styleRuns[], int styleRunCount) { int i; // iterate over style runs if (direction == Bidi.LTR) { int styleLimit; for (i = 0; i < styleRunCount; ++i) { styleLimit = styleRuns[i].limit; if (start < styleLimit) { if (styleLimit > limit) { styleLimit = limit; } renderRun(text, start, styleLimit, direction, styleRuns[i].style); if (styleLimit == limit) { break; } start = styleLimit; } } } else { int styleStart; for (i = styleRunCount-1; i >= 0; --i) { if (i > 0) { styleStart = styleRuns[i-1].limit; } else { styleStart = 0; } if (limit >= styleStart) { if (styleStart < start) { styleStart = start; } renderRun(text, styleStart, limit, direction, styleRuns[i].style); if (styleStart == start) { break; } limit = styleStart; } } } } // the line object represents text[start..limit-1] static void renderLine(Bidi line, String text, int start, int limit, StyleRun styleRuns[], int styleRunCount) { byte direction = line.getDirection(); if (direction != Bidi.MIXED) { // unidirectional if (styleRunCount <= 1) { renderRun(text, start, limit, direction, styleRuns[0].style); } else { renderDirectionalRun(text, start, limit, direction, styleRuns, styleRunCount); } } else { // mixed-directional int count, i; BidiRun run; try { count = line.countRuns(); } catch (IllegalStateException e) { e.printStackTrace(); return; } if (styleRunCount <= 1) { int style = styleRuns[0].style; // iterate over directional runs for (i = 0; i < count; ++i) { run = line.getVisualRun(i); renderRun(text, run.getStart(), run.getLimit(), run.getDirection(), style); } } else { // iterate over both directional and style runs for (i = 0; i < count; ++i) { run = line.getVisualRun(i); renderDirectionalRun(text, run.getStart(), run.getLimit(), run.getDirection(), styleRuns, styleRunCount); } } } } static void renderParagraph(String text, byte textDirection, StyleRun styleRuns[], int styleRunCount, int lineWidth) { int length = text.length(); Bidi para = new Bidi(); try { para.setPara(text, textDirection != 0 ? Bidi.LEVEL_DEFAULT_RTL : Bidi.LEVEL_DEFAULT_LTR, null); } catch (Exception e) { e.printStackTrace(); return; } byte paraLevel = (byte)(1 & para.getParaLevel()); StyleRun styleRun = new StyleRun(length, styleNormal); if (styleRuns == null || styleRunCount <= 0) { styleRuns = new StyleRun[1]; styleRunCount = 1; styleRuns[0] = styleRun; } // assume styleRuns[styleRunCount-1].limit>=length int width = getTextWidth(text, 0, length, styleRuns, styleRunCount); if (width <= lineWidth) { // everything fits onto one line // prepare rendering a new line from either left or right startLine(paraLevel, width); renderLine(para, text, 0, length, styleRuns, styleRunCount); } else { // we need to render several lines Bidi line = new Bidi(length, 0); int start = 0, limit; int styleRunStart = 0, styleRunLimit; for (;;) { limit = length; styleRunLimit = styleRunCount; width = getLineBreak(text, new Bounds(start, limit), para, styleRuns, new Bounds(styleRunStart, styleRunLimit)); try { line = para.setLine(start, limit); } catch (Exception e) { e.printStackTrace(); return; } // prepare rendering a new line // from either left or right startLine(paraLevel, width); if (styleRunStart > 0) { int newRunCount = styleRuns.length - styleRunStart; StyleRun[] newRuns = new StyleRun[newRunCount]; System.arraycopy(styleRuns, styleRunStart, newRuns, 0, newRunCount); renderLine(line, text, start, limit, newRuns, styleRunLimit - styleRunStart); } else { renderLine(line, text, start, limit, styleRuns, styleRunLimit - styleRunStart); } if (limit == length) { break; } start = limit; styleRunStart = styleRunLimit - 1; if (start >= styleRuns[styleRunStart].limit) { ++styleRunStart; } } } } public static void main(String[] args) { renderParagraph("Some Latin text...", Bidi.LTR, null, 0, 80); renderParagraph("Some Hebrew text...", Bidi.RTL, null, 0, 60); } }

java.text.Bidi
This class implements the Unicode Bidirectional Algorithm.
A Bidi object provides information on the bidirectional reordering of the text used to create it. This is required, for example, to properly display Arabic or Hebrew text. These languages are inherently mixed directional, as they order numbers from left-to-right while ordering most other text from right-to-left.
Once created, a Bidi object can be queried to see if the text it represents is all left-to-right or all right-to-left. Such objects are very lightweight and this text is relatively easy to process.
If there are multiple runs of text, information about the runs can be accessed by indexing to get the start, limit, and level of a run. The level represents both the direction and the 'nesting level' of a directional run. Odd levels are right-to-left, while even levels are left-to-right. So for example level 0 represents left-to-right text, while level 1 represents right-to-left text, and level 2 represents left-to-right text embedded in a right-to-left run. @since 1.4
org.docx4j.model.properties.paragraph.Bidi

Examples of java.text.Bidi

    assertTrue(bd.isMixed());
    assertFalse(bd.isRightToLeft());
  }


  public void testComplicatedOverrideBidi() {
    bd = new Bidi("a\u05D0a\"a\u05D0\"\u05D0a".toCharArray(), 0,
        new byte[] { 0, 0, 0, -3, -3, 2, 2, 0, 3 }, 0, 9,
        Bidi.DIRECTION_RIGHT_TO_LEFT);
    assertFalse(bd.baseIsLeftToRight());
    assertEquals(1, bd.getBaseLevel());
    assertEquals(9, bd.getLength());

View Full Code Here

Examples of java.text.Bidi

    assertFalse(Bidi.requiresBidi("aa\u05D0a".toCharArray(), 0, 2));
    assertTrue(Bidi.requiresBidi("aa\u05D0a".toCharArray(), 1, 3));
  }


  public void testHebrewOverrideEmbeddings() {
    bd = new Bidi(new char[] { '\u05D0', '\u05D0', '\u05D0' }, 0,
        new byte[] { (byte) -1, (byte) -2, (byte) -3 }, 0, 3,
        Bidi.DIRECTION_DEFAULT_LEFT_TO_RIGHT);
    assertFalse(bd.baseIsLeftToRight());
    assertEquals(1, bd.getBaseLevel());
    assertEquals(3, bd.getLength());
    assertEquals(1, bd.getLevelAt(0));
    assertEquals(2, bd.getLevelAt(1));
    assertEquals(3, bd.getLevelAt(2));
    assertEquals(1, bd.getLevelAt(1000));
    assertEquals(3, bd.getRunCount());
    assertRunArrayEquals(new int[][] { { 0, 1, 1 }, { 1, 2, 2 },
        { 2, 3, 3 }, }, bd);
    assertFalse(bd.isLeftToRight());
    assertTrue(bd.isMixed());
    assertFalse(bd.isRightToLeft());


    bd = new Bidi(new char[] { '\u05D0', '\u05D0', '\u05D0' }, 0,
        new byte[] { (byte) -1, (byte) -2, (byte) -3 }, 0, 3,
        Bidi.DIRECTION_DEFAULT_RIGHT_TO_LEFT);
    assertFalse(bd.baseIsLeftToRight());
    assertEquals(1, bd.getBaseLevel());
    assertEquals(3, bd.getLength());
    assertEquals(1, bd.getLevelAt(0));
    assertEquals(2, bd.getLevelAt(1));
    assertEquals(3, bd.getLevelAt(2));
    assertEquals(1, bd.getLevelAt(1000));
    assertEquals(3, bd.getRunCount());
    assertRunArrayEquals(new int[][] { { 0, 1, 1 }, { 1, 2, 2 },
        { 2, 3, 3 }, }, bd);
    assertFalse(bd.isLeftToRight());
    assertTrue(bd.isMixed());
    assertFalse(bd.isRightToLeft());


    bd = new Bidi(new char[] { '\u05D0', '\u05D0', '\u05D0' }, 0,
        new byte[] { (byte) -1, (byte) -2, (byte) -3 }, 0, 3,
        Bidi.DIRECTION_LEFT_TO_RIGHT);
    assertTrue(bd.baseIsLeftToRight());
    assertEquals(0, bd.getBaseLevel());
    assertEquals(3, bd.getLength());
    assertEquals(1, bd.getLevelAt(0));
    assertEquals(2, bd.getLevelAt(1));
    assertEquals(3, bd.getLevelAt(2));
    assertEquals(0, bd.getLevelAt(1000));
    assertEquals(3, bd.getRunCount());
    assertRunArrayEquals(new int[][] { { 0, 1, 1 }, { 1, 2, 2 },
        { 2, 3, 3 }, }, bd);
    assertFalse(bd.isLeftToRight());
    assertTrue(bd.isMixed());
    assertFalse(bd.isRightToLeft());


    bd = new Bidi(new char[] { '\u05D0', '\u05D0', '\u05D0' }, 0,
        new byte[] { (byte) -1, (byte) -2, (byte) -3 }, 0, 3,
        Bidi.DIRECTION_RIGHT_TO_LEFT);
    assertFalse(bd.baseIsLeftToRight());
    assertEquals(1, bd.getBaseLevel());
    assertEquals(3, bd.getLength());

View Full Code Here

Examples of java.text.Bidi

    assertTrue(bd.isMixed());
    assertFalse(bd.isRightToLeft());
  }


  public void testCreateLineBidi() {
    bd = new Bidi("a\u05D0a\na\u05D0\"\u05D0a".toCharArray(), 0,
        new byte[] { 0, 0, 0, -3, -3, 2, 2, 0, 3 }, 0, 9,
        Bidi.DIRECTION_RIGHT_TO_LEFT);
    Bidi line = bd.createLineBidi(2, 7);
    assertFalse(line.baseIsLeftToRight());
    assertEquals(1, line.getBaseLevel());
    assertEquals(5, line.getLength());
    assertEquals(2, line.getLevelAt(0));
    assertEquals(1, line.getLevelAt(1));
    assertEquals(3, line.getLevelAt(2));
    assertEquals(3, line.getLevelAt(3));
    assertEquals(2, line.getLevelAt(4));
    assertEquals(1, line.getLevelAt(1000));
    assertEquals(4, line.getRunCount());
    assertRunArrayEquals(new int[][] { { 0, 1, 2 }, { 1, 2, 1 },
        { 2, 4, 3 }, { 4, 5, 2 }, }, line);
    assertFalse(line.isLeftToRight());
    assertTrue(line.isMixed());
    assertFalse(line.isRightToLeft());
  }

View Full Code Here

Examples of java.text.Bidi

    harness.check(buf.toString(), expected);
  }


  public void test(TestHarness harness)
  {
    Bidi b;


    harness.checkPoint("simple");
    b = new Bidi("hi bob", Bidi.DIRECTION_DEFAULT_LEFT_TO_RIGHT);
    testOne(harness, b, "000000");
    harness.check(b.baseIsLeftToRight());
    harness.check(b.isLeftToRight());
    harness.check(b.getRunCount(), 1);


    harness.checkPoint("one embedding");
    b = new Bidi("hi \u202bbob", Bidi.DIRECTION_DEFAULT_LEFT_TO_RIGHT);
    testOne(harness, b, "0002222");


    harness.checkPoint("override");
    b = new Bidi("hi \u202ebob", Bidi.DIRECTION_DEFAULT_LEFT_TO_RIGHT);
    testOne(harness, b, "0001111");


    harness.checkPoint("override and pop");
    b = new Bidi("car means \u202eCAR\u202c.",
        Bidi.DIRECTION_DEFAULT_LEFT_TO_RIGHT);
    testOne(harness, b, "0000000000111100");
    b = new Bidi("car \u202eMEANS CAR\u202c.",
          Bidi.DIRECTION_RIGHT_TO_LEFT);
    testOne(harness, b, "2221333333333311");
  }

View Full Code Here

Examples of java.text.Bidi


        try {
            content.getChars(parStart, parLen, text);
        } catch (final BadLocationException e) { }


        Bidi bidi = new Bidi(text.array, text.offset, null, 0, text.count,
                             getDefaultDirection(par));


        final int runCount = bidi.getRunCount();
        for (int i = 0; i < runCount; i++) {
            int level = bidi.getRunLevel(i);


            if (i == 0 && added.size() > 0) {
                Element prevBidi = (Element)added.get(added.size() - 1);
                if (getBidiLevel(prevBidi) == level) {
                    added.remove(added.size() - 1);
                    added.add(new BidiElement(prevBidi.getAttributes(),
                                              prevBidi.getStartOffset(),
                                              parStart + bidi.getRunLimit(i)));
                    continue;
                }
            }


            added.add(
                new BidiElement(context.addAttribute(context.getEmptySet(),
                                                     StyleConstants.BidiLevel,
                                                     new Integer(level)),
                                parStart + bidi.getRunStart(i),
                                parStart + bidi.getRunLimit(i)));
        }


    }

View Full Code Here

Examples of java.text.Bidi

                                  text.offset + text.count)) {


            return false;
        }


        final Bidi bidi = new Bidi(text.array, text.offset, null, 0, text.count,
                                   getDefaultDirection(offset));


        if (hasBidiInfo && !bidi.isMixed()
            && isLeftToRight(offset) == bidi.isLeftToRight()) {


            return false;
        }


        if (!hasBidiInfo) {

View Full Code Here

Examples of java.text.Bidi

                getText(pStart, pEnd-pStart, seg);
            } catch (BadLocationException e ) {
                throw new Error("Internal error: " + e.toString());
            }
            // REMIND(bcb) we should really be using a Segment here.
            Bidi bidiAnalyzer;
            int bidiflag = Bidi.DIRECTION_DEFAULT_LEFT_TO_RIGHT;
            if (direction != null) {
                if (TextAttribute.RUN_DIRECTION_LTR.equals(direction)) {
                    bidiflag = Bidi.DIRECTION_LEFT_TO_RIGHT;
                } else {
                    bidiflag = Bidi.DIRECTION_RIGHT_TO_LEFT;
                }
            }
            bidiAnalyzer = new Bidi(seg.array, seg.offset, null, 0, seg.count,
                    bidiflag);
            BidiUtils.getLevels(bidiAnalyzer, levels, levelsEnd);
            levelsEnd += bidiAnalyzer.getLength();


            o =  p.getEndOffset();
            SegmentCache.releaseSharedSegment(seg);
        }

View Full Code Here

Examples of java.text.Bidi

                                              boolean isDirectionLTR,
                                              float[] baselineOffsets) {


        factory.setLineContext(0, chars.length);


        Bidi lineBidi = factory.getLineBidi();
        int[] charsLtoV = null;
        byte[] levels = null;


        if (lineBidi != null) {
            levels = BidiUtils.getLevels(lineBidi);

View Full Code Here

Examples of java.text.Bidi

                                                  AttributedCharacterIterator text,
                                                  char[] chars,
                                                  float[] baselineOffsets) {


        StyledParagraph styledParagraph = new StyledParagraph(text, chars);
        Bidi bidi = new Bidi(text);
        if (bidi.isLeftToRight()) {
            bidi = null;
        }
        int layoutFlags = 0; // no extra info yet, bidi determines run and line direction
        TextLabelFactory factory = new TextLabelFactory(frc, chars, bidi, layoutFlags);


        boolean isDirectionLTR = true;
        if (bidi != null) {
            isDirectionLTR = bidi.baseIsLeftToRight();
        }
        return createLineFromText(chars, styledParagraph, factory, isDirectionLTR, baselineOffsets);
    }

View Full Code Here

Examples of java.text.Bidi


      labelSize = 0;


      if (bidiRequired)
      {
        Bidi bidi = new Bidi(label,
            Bidi.DIRECTION_DEFAULT_LEFT_TO_RIGHT);


        int runCount = bidi.getRunCount();


        if (rtlGlyphVectors == null
            || rtlGlyphVectors.length != runCount)
        {
          rtlGlyphVectors = new GlyphVector[runCount];
        }


        for (int i = 0; i < bidi.getRunCount(); i++)
        {
          final String labelSection = label.substring(
              bidi.getRunStart(i), bidi.getRunLimit(i));
          rtlGlyphVectors[i] = font
              .layoutGlyphVector(mxCurveLabelShape.frc,
                  labelSection.toCharArray(), 0,
                  labelSection.length(),
                  Font.LAYOUT_RIGHT_TO_LEFT);

View Full Code Here

0 1 2 3 4 5

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.