April showers? Ha!
Taken outside my driveway:
Update: getting heavier now, near white-out at times. Another shot from the Apple iBlurryCamPhone:
Digg just released a prototype of their optimized data streams. This this is pretty cool. It uses MIME multipart HTTP responses to return a stream of responses, dispatching each one as it comes in. Bugzilla has been using MIME multipart for a while, though only to serve a short “Bugzilla is searching for your bugs” message before returning the actual results.
I’m still digging through it but it looks like a great way to deal with large numbers of resources at pageload time. As an example, you can batch 50 individual profile images in a single HTTP connection roundtrip to populate your frontpage, versus having to serve 50 individual images, or having to manually stitch them into a single image on the server side.
Assuming you can scale it well on the server, you could potentially multiplex a few long-running API calls on a single stream as well. As each one is ready, you could then throw it down the pipe and deal with it on the client.
The concept is cool. There are some limitations obviously, but it’s a fantastic way to deal with bulk data transfer.
More at ReadWriteWeb and Digg the Blog.
The news that Oracle bought Sun caught me off guard. I was moderately disappointed when they were courting IBM as a suitor, but I would have been more than happy if they had gone through with the deal. IBM understands open-source and has a proven track record in Eclipse.
The best case scenario for Java would have been a acquisition by or a merger with RedHat, though that would be very unlikely considering the size of RedHat itself – Sun is almost four times bigger than RedHat. Out of some of the big software names large enough to buy and aggregate Sun’s high-end open-source assets, Google would have been a great choice. They have shown a great deal of leadership in the open-source community. We would have seen a vibrant community spring up out of this – consider how well the large GWT open-source projects are run.
So, what does the future hold for Java now? I can’t tell, but the I think the best case is status quo for now. I hope that Oracle spins Java off into its own, independent organization in the future.
If it comes down to it, the community will route around any damage. It started down that path once before with Classpath and Apache Harmony, but those didn’t turn out to be necessary at the time. Who knows – maybe Oracle will change through this whole process? I’m not holding my breath, however.
I’ve blogged about the subject of GWT JVM crashes far too much (here and here). This is, I hope, the final word on the subject. I spent some time disassembling the Google Eclipse plugin (did I agree not to do that in one of the EULAs?
) and discovered that they are launching the JVM without using the Eclipse infrastructure. This means that the JVM arguments are effectively hardcoded, except in one case where -startOnFirstThread is passed for OSX clients. For those interested, the buggy classes of note are GWTDeploymentParticipant and LaunchUtils.
I posted a note on the contributor’s list and received a response from a Googler suggesting that I wrap my Java executable in a shell script. Not one to shy away from wrapping system executables with scripts, I decided to give it a shot tonight. My first shell script attempt was a disaster (dear lazyweb: how can you get bash to respect quoted spaces when using $@?), so I gave it a whack in Python.
This is tested and somewhat guaranteed to work for JVM 1.6 under OSX:
cd /System/Library/Frameworks/JavaVM.framework/Versions/1.6.0/Home/bin sudo mv java java_wrapped sudo nano java
And the script:
#!/usr/bin/env python
import sys
import os
print sys.argv
cmd = os.path.dirname(sys.argv[0]) + '/java_wrapped'
args = ['',
'-XX:CompileCommand=exclude,org/eclipse/core/internal/dtree/DataTreeNode,forwardDeltaWith',
'-XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedTypeBinding,<init>',
'-XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedMethodBinding,<init>']
args.extend(sys.argv[1:])
print cmd
print args
print ""
os.execv(cmd, args)
If you have any suggestions on how to improve my Python, I’d be glad to hear them in the comments.
UPDATE: Thanks to Vitali, I got a bash script working as well:
#!/bin/bash
`dirname $0`/java_wrapped \
"-XX:CompileCommand=exclude,org/eclipse/core/internal/dtree/DataTreeNode,forwardDeltaWith" \
"-XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedTypeBinding,<init>" \
"-XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedMethodBinding,<init>" \
"$@"
UPDATE, Apr 19 2009: This does not fix all compiler crashes in Eclipse. This is only useful for the compiler crashes where an Eclipse JVM configuration is used. Please see my later blog post for a better fix and disregard this information.
This is the same error I hit before (see my earlier post), but it happens in Eclipse during the “deploy to AppEngine” phase. You’ll see it if you’ve got a project configured with a 1.6 JVM on the build path (even if your .class compatibility is set to 1.5). It’s not obvious how to fix this at first glance – I had to dig around to find the options that Eclipse passes to the JVM.
You can fix it by adding the same compiler workarounds we explored before to your JVM default arguments. IMPORTANT NOTE: Add the args to all of your 1.6 level installed JVMs. I’ve found that Eclipse doesn’t always choose the selected one if there’s an equivalent also installed (ie: it may use your ’1.6′ JVM if you have ’1.6.0′ selected).
-XX:CompileCommand=exclude,org/eclipse/core/internal/dtree/DataTreeNode,forwardDeltaWith -XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedTypeBinding,<init> -XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedMethodBinding,<init>
Add them to your JVMs under Preferences > Java > Installed JREs by clicking the edit button and filling out “Default VM Arguments”:
Google’s new profile editor uses GWT, cool!
Looks like they aren’t obfuscating class names yet (a feature that just landed on the tip of trunk, IIRC):
http://www.google.com/s2/gwt/resources/9312606AE1FEAAD063F34A9446584258.cache.js
The name of the project is “com.google.focus” and there are references to codenames: “evergreen” (contact info DB?) and “publicusername”. They are also pulling some of the code from Google Collections into the final output.
There’s a bug in the latest Java 1.6 that Apple provides that gets tickled by the GWT 1.6 compiler. It manifests as a reproducible HotSpot compiler crash that looks like this:
[java] Invalid memory access of location 00000000 rip=01160767
When you look into the crash logs that Java produces (found under ~/Library/Logs/CrashReporter/java_*), you can see that HotSpot was compiling a method when it crashed:
Java VM: Java HotSpot(TM) 64-Bit Server VM (1.6.0_07-b06-57 mixed mode macosx-amd64) Current thread (0x0000000101843800): JavaThread "CompilerThread1" daemon [_thread_in_native, id=1756672000, stack(0x0000000168a4b000,0x0000000168b4b000)] Stack: [0x0000000168a4b000,0x0000000168b4b000] Current CompileTask: C2:637 org.eclipse.jdt.internal.compiler.lookup.ParameterizedMethodBinding.<init>(Lorg/eclipse/jdt/internal/compiler/lookup/ParameterizedTypeBinding;Lorg/eclipse/jdt/internal/compiler/lookup/MethodBinding;)V (596 bytes)
The workaround is to disable JIT of some JDT methods using some advanced JVM command-line arguments. Using Ant, you can tack them on to your GWT compiler task <java> blocks, like so:
<java classname="com.google.gwt.dev.Compiler" classpathref="compileClassPath@{module}" fork="true" failonerror="true">
...
<jvmarg value="-XX:CompileCommand=exclude,org/eclipse/core/internal/dtree/DataTreeNode,forwardDeltaWith" />
<jvmarg value="-XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedTypeBinding,<init>" />
<jvmarg value="-XX:CompileCommand=exclude,org/eclipse/jdt/internal/compiler/lookup/ParameterizedMethodBinding,<init>" />
By applying those commands, you ask the HotSpot compiler to skip those methods (relying on the interpreter to run them). You’ll know it’s working if you see this during your compile:
[java] CompilerOracle: exclude org/eclipse/core/internal/dtree/DataTreeNode.forwardDeltaWith [java] CompilerOracle: exclude org/eclipse/jdt/internal/compiler/lookup/ParameterizedTypeBinding.<init> [java] CompilerOracle: exclude org/eclipse/jdt/internal/compiler/lookup/ParameterizedMethodBinding.<init> [java] Compiling module com.dotspots.ExtensionModule
I’m hoping that Apple eventually gets around to releasing an updated Java 1.6 for OSX. This bug was fixed in mainline Java a very long time ago!
We’ve been trying out Google’s Eclipse plugin for the last week and it’s made a huge difference to our GWT development experience. The plugin is designed to enhance your Java AppEngine and GWT workflow. We’re mainly using it for GWT development, so the biggest wins for us are the GWT features, including:
There’s some cool support for AppEngine in the plugin as well. You can publish a hybrid GWT/AppEngine project to Google’s servers with a couple of clicks. This makes the development/deploy cycle trivial, allowing you to quickly iterate using the same environment as your production applications. With this new toolset, AppEngine is an easier platform to deploy to than servers you own and operate yourself, IMHO.
Aside: one interesting feature that slipped under the radar for this AppEngine release is support for cron-style jobs. While this was possible using a cron job on a managed server hitting a URL on your application instance, implementing it in the platform itself makes life easier for web developers. Note that this isn’t true cron, but rather a “hit this URL on this schedule” feature. I actually prefer having cron jobs exposed as web endpoints – it saves you from having to duplicate your web framework’s infrastructure setup in a command-line application.
All-in-all, a very cool release. Thanks to the GWT and AppEngine teams for making this a reality.