Examples of SnappyOutputStream

org.iq80.snappy.SnappyOutputStream
This class implements an output stream for writing Snappy compressed data. The output format is the stream header "snappy\0" followed by one or more compressed blocks of data, each of which is preceded by a seven byte header.
The first byte of the header is a flag indicating if the block is compressed or not. A value of 0x00 means uncompressed, and 0x01 means compressed.
The second and third bytes are the size of the block in the stream as a big endian number. This value is never zero as empty blocks are never written. The maximum allowed length is 32k (1 << 15).
The remaining four byes are crc32c checksum of the user input data masked with the following function: {@code ((crc >>> 15) | (crc << 17)) + 0xa282ead8 }
An uncompressed block is simply copied from the input, thus guaranteeing that the output is never larger than the input (not including the header).
org.xerial.snappy.SnappyOutputStream
This class implements a stream filter for writing compressed data using Snappy.
The input data is blocked into 32kb size (in default), and each block is compressed and then passed to the given {@link OutputStream}.
The output data format is:
1. snappy codec header defined in {@link SnappyCodec} (8 bytes)
2. compressed block 1 : a pair of (compressed data size [4 byte integer. Big-endian], compressed data...)
3. compressed block 2
4. ...
Note that the compressed data created by {@link SnappyOutputStream} cannot beuncompressed by {@link Snappy#uncompress(byte[])} since the output formats of{@link Snappy#compress(byte[])} and {@link SnappyOutputStream} are different.Use {@link SnappyInputStream} for uncompress the data generated by{@link SnappyOutputStream}. @author leo

Examples of org.iq80.snappy.SnappyOutputStream

    public String getType() {
        return "snappy";
    }


    protected OutputStream wrapOutputStream(OutputStream underlying) throws IOException {
        return new SnappyOutputStream(underlying);
    }

View Full Code Here

Examples of org.iq80.snappy.SnappyOutputStream


        return byteArrayOutputStream.toByteArray();
    }


    public static void compress(byte[] in, OutputStream out) throws IOException {
        SnappyOutputStream snappyOutputStream = new SnappyOutputStream(out);
        snappyOutputStream.write(in);
        snappyOutputStream.close();
    }

View Full Code Here

Examples of org.iq80.snappy.SnappyOutputStream


        byte[] origBytes = messagePack.write(object);
        System.out.println("orig length: " + origBytes.length);


        ByteArrayOutputStream out = new ByteArrayOutputStream();
        SnappyOutputStream snappyOutputStream = new SnappyOutputStream(out);
        snappyOutputStream.write(origBytes);
        snappyOutputStream.close();


        byte[] comressedBytes = out.toByteArray();
        System.out.println("comressedBytes length: " + comressedBytes.length);


        byte[] bytes = cipherEncrypt.get().doFinal(comressedBytes);

View Full Code Here

Examples of org.iq80.snappy.SnappyOutputStream

    /**
     * {@inheritDoc}
     */
    @Override
    protected OutputStream wrapCompressInternal(OutputStream out) throws IOException {
        return new SnappyOutputStream(out);
    }

View Full Code Here

Examples of org.iq80.snappy.SnappyOutputStream

//    }


    ByteArrayOutputStream baos = new ByteArrayOutputStream();


    try {
      SnappyOutputStream snappyOutputStream = new SnappyOutputStream(baos);
      snappyOutputStream.write(uncompressedBytes);
      snappyOutputStream.close();
      baos.close();
    } catch (IOException e) {
      // This should not happen
      logger.error("Could not compress sensei request ", e);
    }

View Full Code Here

Examples of org.iq80.snappy.SnappyOutputStream

//    }


    ByteArrayOutputStream baos = new ByteArrayOutputStream();


    try {
      SnappyOutputStream snappyOutputStream = new SnappyOutputStream(baos);
      snappyOutputStream.write(uncompressedBytes);
      snappyOutputStream.close();
      baos.close();
    } catch (IOException e) {
      // This should not happen
      logger.error("Could not compress sensei request ", e);
    }

View Full Code Here

Examples of org.xerial.snappy.SnappyOutputStream

      "Compressed file: " + compressed.toString() + " unexpectedly " +
        "exists.");


    BufferedInputStream in = null;
    FileOutputStream out = null;
    SnappyOutputStream snappyOut = null;
    try {
      in = new BufferedInputStream(new FileInputStream(uncompressed));
      out = new FileOutputStream(compressed);
      snappyOut = new SnappyOutputStream(out);


      byte[] buf = new byte[FILE_BUFFER_SIZE];
      while(true) {
        int read = in.read(buf);
        if (read == -1) {
          break;
        }
        snappyOut.write(buf, 0, read);
      }
      out.getFD().sync();
      return true;
    } catch (Exception ex) {
      LOG.error("Error while attempting to compress " +
        uncompressed.toString() + " to " + compressed.toString()
        + ".", ex);
      Throwables.propagate(ex);
    } finally {
      Throwable th = null;
      try {
        if (in != null) {
          in.close();
        }
      } catch (Throwable ex) {
        LOG.error("Error while closing input file.", ex);
        th = ex;
      }
      try {
        if (snappyOut != null) {
          snappyOut.close();
        }
      } catch (IOException ex) {
        LOG.error("Error while closing output file.", ex);
        Throwables.propagate(ex);
      }

View Full Code Here

Examples of org.xerial.snappy.SnappyOutputStream

                    CompactEndpointSerializationHelper.serialize(FBUtilities.getBroadcastAddress(), out);
                    if (shouldCompressConnection())
                    {
                        out.flush();
                        logger.trace("Upgrading OutputStream to be compressed");
                        out = new DataOutputStream(new SnappyOutputStream(new BufferedOutputStream(socket.getOutputStream())));
                    }
                }


                return true;
            }

View Full Code Here

Examples of org.xerial.snappy.SnappyOutputStream

                    CompactEndpointSerializationHelper.serialize(FBUtilities.getBroadcastAddress(), out);
                    if (shouldCompressConnection())
                    {
                        out.flush();
                        logger.trace("Upgrading OutputStream to be compressed");
                        out = new DataOutputStream(new SnappyOutputStream(new BufferedOutputStream(socket.getOutputStream())));
                    }
                }


                return true;
            }

View Full Code Here

Examples of org.xerial.snappy.SnappyOutputStream

                    CompactEndpointSerializationHelper.serialize(FBUtilities.getBroadcastAddress(), out);
                    if (shouldCompressConnection())
                    {
                        out.flush();
                        logger.trace("Upgrading OutputStream to be compressed");
                        out = new DataOutputStream(new SnappyOutputStream(new BufferedOutputStream(socket.getOutputStream())));
                    }
                }


                return true;
            }

View Full Code Here

0 1 2 3

TOP

All source code are property of their respective owners. Java is a trademark of Sun Microsystems, Inc and owned by ORACLE Inc. Contact coftware#gmail.com.