Examples of java.nio.charset.CharsetEncoder

java.nio.charset.CharsetEncoder
An converter that can convert 16-bit Unicode character sequence to byte sequence in some charset .
The input character sequence is wrapped by {@link java.nio.CharBuffer CharBuffer} and the output character sequence is{@link java.nio.ByteBuffer ByteBuffer}. A encoder instance should be used in following sequence, which is referred to as a encoding operation:
1. Invoking the {@link #reset() reset} method to reset the encoder if theencoder has been used;
2. Invoking the {@link #encode(CharBuffer,ByteBuffer,boolean) encode}method until the addtional input is not needed, the endOfInput parameter must be set to false, the input buffer must be filled and the output buffer must be flushed between invocations;
3. Invoking the {@link #encode(CharBuffer,ByteBuffer,boolean) encode}method last time, and the the endOfInput parameter must be set to true
4. Invoking the {@link #flush(ByteBuffer) flush} method to flush theoutput.
The {@link #encode(CharBuffer,ByteBuffer,boolean) encode} method willconvert as many characters as possible, and the process won't stop except the input characters has been run out of, the output buffer has been filled or some error has happened. A {@link CoderResult CoderResult} instance will bereturned to indicate the stop reason, and the invoker can identify the result and choose further action, which can include filling the input buffer, flushing the output buffer, recovering from error and trying again.

There are two common encoding errors. One is named as malformed and it is returned when the input content is illegal 16-bit Unicode character sequence, the other is named as unmappable character and occurs when there is a problem mapping the input to a valid byte sequence in the specific charset.

The two errors can be handled in three ways, the default one is to report the error to the invoker by a {@link CoderResult CoderResult} instance, and thealternatives are to ignore it or to replace the erroneous input with the replacement byte array. The replacement byte array is {(byte)'?'} by default and can be changed by invoking {@link #replaceWith(byte[]) replaceWith}method. The invoker of this encoder can choose one way by specifing a {@link CodingErrorAction CodingErrorAction} instance for each error type via{@link #onMalformedInput(CodingErrorAction) onMalformedInput} method and{@link #onUnmappableCharacter(CodingErrorAction) onUnmappableCharacter}method.

This class is abstract class and encapsulate many common operations of encoding process for all charsets. encoder for specific charset should extend this class and need only implement {@link #encodeLoop(CharBuffer,ByteBuffer) encodeLoop} method for basicencoding loop. If a subclass maintains internal state, it should override the {@link #implFlush(ByteBuffer) implFlush} method and{@link #implReset() implReset} method in addition.

This class is not thread-safe.
@see java.nio.charset.Charset @see java.nio.charset.CharsetDecoder

    }
    
    final Charset charset = Charset.forName(encoding);
    if (charset.canEncode())
    {
      final CharsetEncoder charsetEncoder = charset.newEncoder();
      final char[] chars = result.toCharArray();
      final StringBuffer b = new StringBuffer(chars.length);
      for (int i = 0; i < chars.length; i++)
      {
        final char c = chars[i];
        if (charsetEncoder.canEncode(c))
        {
          b.append(c);
        }
      }
      return b.toString();

View Full Code Here

     * Method name inspired by PHP's rawurlencode.
     */
    public static String rawEncode(String s) {
        boolean escaped = false;
        StringBuilder out = null;
        CharsetEncoder enc = null;
        CharBuffer buf = null;
        char c;
        for (int i = 0, m = s.length(); i < m; i++) {
            c = s.charAt(i);
            if (c > 122 || uriMap[c]) {
                if (!escaped) {
                    out = new StringBuilder(i + (m - i) * 3);
                    out.append(s.substring(0, i));
                    enc = Charset.forName("UTF-8").newEncoder();
                    buf = CharBuffer.allocate(1);
                    escaped = true;
                }
                // 1 char -> UTF8
                buf.put(0,c);
                buf.rewind();
                try {
                    ByteBuffer bytes = enc.encode(buf);
                    while (bytes.hasRemaining()) {
                        byte b = bytes.get();
                        out.append('%');
                        out.append(toDigit((b >> 4) & 0xF));
                        out.append(toDigit(b & 0xF));

View Full Code Here


        //将输入文件的通道通过只读的权限 映射到内存中。
        MappedByteBuffer byteMapper = inChannel.map(FileChannel.MapMode.READ_ONLY, 0, (int) inFile.length());


        CharsetDecoder inDecoder = inCharset.newDecoder();
        CharsetEncoder outEncoder = outCharset.newEncoder();


        CharBuffer cb = inDecoder.decode(byteMapper);
        ByteBuffer outBuffer = null;
        try {
            outBuffer = outEncoder.encode(cb);


            RandomAccessFile outRandom = null;
            FileChannel outChannel = null;
            if (outFile != null) {
                try {

View Full Code Here

    {
        TextLineDecoder decoder =
            new TextLineDecoder(
                    Charset.forName( "UTF-8" ), LineDelimiter.WINDOWS );
        
        CharsetEncoder encoder = Charset.forName( "UTF-8" ).newEncoder();
        IoSession session = new DummySession();
        SimpleProtocolDecoderOutput out = new SimpleProtocolDecoderOutput();
        ByteBuffer in = ByteBuffer.allocate( 16 );
     
        // Test one decode and one output

View Full Code Here

    {
        TextLineDecoder decoder =
            new TextLineDecoder(
                    Charset.forName( "UTF-8" ), LineDelimiter.AUTO );
        
        CharsetEncoder encoder = Charset.forName( "UTF-8" ).newEncoder();
        IoSession session = new DummySession();
        SimpleProtocolDecoderOutput out = new SimpleProtocolDecoderOutput();
        ByteBuffer in = ByteBuffer.allocate( 16 );
     
        // Test one decode and one output

View Full Code Here


    @Override
    public ManagedHttpClientConnection create(final HttpRoute route, final ConnectionConfig config) {
        final ConnectionConfig cconfig = config != null ? config : ConnectionConfig.DEFAULT;
        CharsetDecoder chardecoder = null;
        CharsetEncoder charencoder = null;
        final Charset charset = cconfig.getCharset();
        final CodingErrorAction malformedInputAction = cconfig.getMalformedInputAction() != null ?
                cconfig.getMalformedInputAction() : CodingErrorAction.REPORT;
        final CodingErrorAction unmappableInputAction = cconfig.getUnmappableInputAction() != null ?
                cconfig.getUnmappableInputAction() : CodingErrorAction.REPORT;
        if (charset != null) {
            chardecoder = charset.newDecoder();
            chardecoder.onMalformedInput(malformedInputAction);
            chardecoder.onUnmappableCharacter(unmappableInputAction);
            charencoder = charset.newEncoder();
            charencoder.onMalformedInput(malformedInputAction);
            charencoder.onUnmappableCharacter(unmappableInputAction);
        }
        final String id = "http-outgoing-" + Long.toString(COUNTER.getAndIncrement());
        return new LoggingManagedHttpClientConnection(
                id,
                log,

View Full Code Here

        return wrappedBuffer(string.getBytes(charset));
    }


    public static ByteBuffer encodeString(CharBuffer src, Charset charset)
    {
        final CharsetEncoder encoder = getEncoder(charset);
        final ByteBuffer dst = ByteBuffer.allocate(
                (int) ((double) src.remaining() * encoder.maxBytesPerChar()));
        try {
            CoderResult cr = encoder.encode(src, dst, true);
            if (!cr.isUnderflow()) {
                cr.throwException();
            }
            cr = encoder.flush(dst);
            if (!cr.isUnderflow()) {
                cr.throwException();
            }
        }
        catch (CharacterCodingException x) {

View Full Code Here

        if (charset == null) {
            throw new NullPointerException("charset");
        }


        Map<Charset, CharsetEncoder> map = encoders.get();
        CharsetEncoder e = map.get(charset);
        if (e != null) {
            e.reset();
            e.onMalformedInput(CodingErrorAction.REPLACE);
            e.onUnmappableCharacter(CodingErrorAction.REPLACE);
            return e;
        }


        e = charset.newEncoder();
        e.onMalformedInput(CodingErrorAction.REPLACE);
        e.onUnmappableCharacter(CodingErrorAction.REPLACE);
        map.put(charset, e);
        return e;
    }

View Full Code Here

              }
          }
      */
      try
      {
         CharsetEncoder encoder = charset.newEncoder();
         ByteArrayOutputStream baos = new ByteArrayOutputStream();
         OutputStreamWriter writer = new OutputStreamWriter(baos, encoder);
         writer.write(c);
         writer.close();
         return baos.toByteArray();

View Full Code Here

   * @return ByteBuffer: bytes stores at ByteBuffer.array() 
   *                     and length is ByteBuffer.limit()
   */
  public static ByteBuffer encode(String string, boolean replace)
    throws CharacterCodingException {
    CharsetEncoder encoder = ENCODER_FACTORY.get();
    if (replace) {
      encoder.onMalformedInput(CodingErrorAction.REPLACE);
      encoder.onUnmappableCharacter(CodingErrorAction.REPLACE);
    }
    ByteBuffer bytes = 
      encoder.encode(CharBuffer.wrap(string.toCharArray()));
    if (replace) {
      encoder.onMalformedInput(CodingErrorAction.REPORT);
      encoder.onUnmappableCharacter(CodingErrorAction.REPORT);
    }
    return bytes;
  }

View Full Code Here

0 1 2 3 4 5 6 7 8 9

TOP

Related Classes of java.nio.charset.CharsetEncoder

com.alibaba.json.bvt.serializer.SerialWriterStringEncoderTest2

com.alimama.mdrill.utils.zip.NioZipEncoding

com.aragost.javahg.internals.Server

com.corundumstudio.socketio.protocol.PacketEncoder

com.datastax.driver.core.TypeCodec$StringCodec

com.google.code.yanf4j.test.unittest.buffer.IoBufferTest

com.googlecode.totallylazy.Characters

com.ibm.icu.dev.test.charset.TestCharset

com.itextpdf.text.pdf.PdfEncodings

com.knife.String.StringConverterUtil

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.