|
I hear that Hadoop uses LZO. What does MapR use? What do I have to install? |
|
MapR uses a variant of LZF modified to improve speed. That said, the compression is build into the file-system at a deep level so that you don't have to install any third-party libraries or change any applications to use compression. Instead, compressed files look just like normal files (but are smaller). You can work on compressed files just as if they were ordinary files. Via NFS, you can even seek, read, write or update compressed files in a completely random access fashion. You can change the default compression settings on a directory by directory basis. |