macos - Encoding issues on Java 7 file names in OS X

Question

I have the following code:

public static void main( String[] args ) {
    System.out.println(Locale.getDefault());
    File f = new File("/Users/johngoering/Documents");
    File[] fs = f.listFiles();
    for (File ff : fs) {
        System.out.println(ff.getName());
        System.out.println(ff.exists());
    }
}

In my Documents folder I have a file called "??.pdf". Here is the output under Java 6:

 en_US
 (...)
 ??.pdf
 true
 (...)

But here is the output under Java 7:

 en_US
 (...)
 o????.pdf
 false
 (...)

Note especially that file.exists returns false for a file returned by listFiles!! What gives? Is there any way to fix this? This seems like quite the Java 7 bug...

Answer 1

With some help from Oracle, we discovered a workaround: the environment variable LC_CTYPE was not set to UTF-8 within Eclipse (and when starting from a JNLP or wherever else). This explains why the code worked on the terminal, since the OS X terminal by default "sets the locale environment variables" (an option which can be turned off and then you get the same issue as above even in the terminal).

Setting this environment variable in the launcher worked around the problem.

I still consider this a bug for Java 7 because Java 6 still worked even WITHOUT this variable.