Mike Haertel forwarded me a link to git subtree.
It goes a long way towards what I want. It doesn't have the intentional branching - what it means for a project to be on the same branch as a subproject library it is using. But it goes a long way, perhaps most of the way, towards what I want.
Disclaimer
The content of this blog is my personal opinion only. Although I am an employee - currently of Nvidia, in the past of other companies such as Iagination Technologies, MIPS, Intellectual Ventures, Intel, AMD, Motorola, and Gould - I reveal this only so that the reader may account for any possible bias I may have towards my employer's products. The statements I make here in no way represent my employer's position, nor am I authorized to speak on behalf of my employer. In fact, this posting may not even represent my personal opinion, since occasionally I play devil's advocate.
See http://docs.google.com/View?id=dcxddbtr_23cg5thdfj for photo credits.
See http://docs.google.com/View?id=dcxddbtr_23cg5thdfj for photo credits.
Friday, June 26, 2009
Am I paranoid, or is this unacceptable?
I'm quite reluctant to blog about this, because it makes me seem crazy. Paranoid.
But: my computer is really slow. Lots of examples documented on this bog. 15 minutes to come out of standby. Pauses of minutes in the middle of writing a document. Etc. Etc.
I cannot imagine that most other employees suffer this slowness. I cannot imagine this being accepted by a wide number of people.
I can imagine that my computer might be slowed down by security software. Not just virus scanners, but possibly keyboard loggers or network traffic recorders or the like. Possibly installed by corporate security or IT or legal. I hope not malware. It often seems to run more slowly after I have blogged in public as I am doing now.
If this is the case, well: I understand that my employer has the right to monitor everything I do on my work computers. I agreed to it. It is US law.
I just wish that it did not impact my productivity so much by slowing down my computer so much.
And if I am being falsely paranoid, if these slowdowns are not the result of monitoring and security software, if other employees experience substantially the same slowdowns: WHY IS THIS TOLERATED!!!!!
But: my computer is really slow. Lots of examples documented on this bog. 15 minutes to come out of standby. Pauses of minutes in the middle of writing a document. Etc. Etc.
I cannot imagine that most other employees suffer this slowness. I cannot imagine this being accepted by a wide number of people.
I can imagine that my computer might be slowed down by security software. Not just virus scanners, but possibly keyboard loggers or network traffic recorders or the like. Possibly installed by corporate security or IT or legal. I hope not malware. It often seems to run more slowly after I have blogged in public as I am doing now.
If this is the case, well: I understand that my employer has the right to monitor everything I do on my work computers. I agreed to it. It is US law.
I just wish that it did not impact my productivity so much by slowing down my computer so much.
And if I am being falsely paranoid, if these slowdowns are not the result of monitoring and security software, if other employees experience substantially the same slowdowns: WHY IS THIS TOLERATED!!!!!
Austin Airport Blog
I’m very happy with Southwest Airlines on this trip. Still cattle car boarding, but the legroom is better than any airline (United, American, Continental, Delta, Northwest) that I have flown recently. My shoulders are still wider than the seats, but that’s true of any airline below first class. (And I never travel first class.)
Here’s a nice touch: by Southwest’s gates in Austin’s Bergstrom airport, they have quite a few (8 that I can see) cabinets with power outlets besides unusually comfortable chairs. They even have USB, to charge up your phone. This is a welcome change from the usual airport “socket hunt”, having to walk all around to find an outlet, often far distant from your gate and requiring you to sit on the floor.
--
Peeve: pay internet.
At the Hilton in Austin: bad enough that I was paying twice what I should have, but that I had to pay 14$/day for Internet in my room as well? Or, rather, I did not pay, except two nights. The conference had free wireless, but with 150 slots for more than 500 people it was usually unavailable. Trouble is, my coworkers expect me to be connected. Now, here I am at the Austin airport, reluctant to pay for Boingo hotspot access. If I did pay, I could have my expense report (which must be completed online via a web app) before I got home. But I won’t pay, so even that trivial task piles up. If I were still at my hotel room I would have the last few of my second 24 hours. It’s not so much the paying for Internet, as the paying for it repeatedly because I am moving around. I swear I will get a data plan for my phone…
--
My new laptop computer has no privacy screen. That has a chilling effect. Must order one. I wonder why my company’s IT department doesn’t automatically provide one. I suppose that I should have ordered one as soon as I got my machine.
The chilling effect: so much for reading email at the conference, when it is visible to all behind me. I wanted to use the free internet at the conference, rather than the pay internet in my room. So much for reading ion the plane. I was willing to risk blogging, but then a few calendar reminders popped up.
Here’s a nice touch: by Southwest’s gates in Austin’s Bergstrom airport, they have quite a few (8 that I can see) cabinets with power outlets besides unusually comfortable chairs. They even have USB, to charge up your phone. This is a welcome change from the usual airport “socket hunt”, having to walk all around to find an outlet, often far distant from your gate and requiring you to sit on the floor.
--
Peeve: pay internet.
At the Hilton in Austin: bad enough that I was paying twice what I should have, but that I had to pay 14$/day for Internet in my room as well? Or, rather, I did not pay, except two nights. The conference had free wireless, but with 150 slots for more than 500 people it was usually unavailable. Trouble is, my coworkers expect me to be connected. Now, here I am at the Austin airport, reluctant to pay for Boingo hotspot access. If I did pay, I could have my expense report (which must be completed online via a web app) before I got home. But I won’t pay, so even that trivial task piles up. If I were still at my hotel room I would have the last few of my second 24 hours. It’s not so much the paying for Internet, as the paying for it repeatedly because I am moving around. I swear I will get a data plan for my phone…
--
My new laptop computer has no privacy screen. That has a chilling effect. Must order one. I wonder why my company’s IT department doesn’t automatically provide one. I suppose that I should have ordered one as soon as I got my machine.
The chilling effect: so much for reading email at the conference, when it is visible to all behind me. I wanted to use the free internet at the conference, rather than the pay internet in my room. So much for reading ion the plane. I was willing to risk blogging, but then a few calendar reminders popped up.
Blogging from ISCA: couldn't keep up
I couldn't keep up. Not only is my typing limited, but my laptop PCs could not keep up.
I am not a touch typist, although I am a very fast hunt and pecker. It's not clear how much value there is to stream of consciousness blogging while I am watching a talk. Why not just get the slides from the speaker? There's value in recording answers to audience questions and off the cuff remarks that won't be on slides. But it is not clear that I will not be hurting myself by making such recordings. E.g. the remarks by HP's Kauffman about Intel's Atom in datacenters.
My company provided HP 8530 laptop is fast enough. When it is up. But when it takes 15 minutes to come out of a power save mode (as mine just did), it is darned easy to miss most of a 20 minute talk.
My OLPC XO is fast enough, and comes out of standby more quickly. I ran into a problem with fairly large text files - at a certain file size it slowed down to a crawl. Even slower than my work PC.
Anyway, enough excuses. My attempt to blog ISCA was not a success. Too bad.
I am not a touch typist, although I am a very fast hunt and pecker. It's not clear how much value there is to stream of consciousness blogging while I am watching a talk. Why not just get the slides from the speaker? There's value in recording answers to audience questions and off the cuff remarks that won't be on slides. But it is not clear that I will not be hurting myself by making such recordings. E.g. the remarks by HP's Kauffman about Intel's Atom in datacenters.
My company provided HP 8530 laptop is fast enough. When it is up. But when it takes 15 minutes to come out of a power save mode (as mine just did), it is darned easy to miss most of a 20 minute talk.
My OLPC XO is fast enough, and comes out of standby more quickly. I ran into a problem with fairly large text files - at a certain file size it slowed down to a crawl. Even slower than my work PC.
Anyway, enough excuses. My attempt to blog ISCA was not a success. Too bad.
Monday, June 22, 2009
Blogging from ISCA: limted WiFi
Only 150 connections for 500 people.
To reduce contention, will blog offline to a text file.
What were we saying about ubiquitous connectivity? You only get that if using cell services.
To reduce contention, will blog offline to a text file.
What were we saying about ubiquitous connectivity? You only get that if using cell services.
Sunday, June 21, 2009
Blogging from ISCA: WDDD: Is TM easier than locks?
Is TM really easier than locks? Programmers must still write critical sections.
Experiment: measure on a class of inexperienced programmers in a UT OS class.
The problem: sync gallery: a rogue's gallery of synchronization. Rogues shoot paint balls in lanes. Cleaners. Etc.
9 different variations: {single lane, two lane, cleaner thread} X {coarse, fine, TM}
TM support: Year1 DSTM2 (Herlihy 06). Year2 JDASTM (Ramadan 09). Library, not langage support.
DSTM syntax baroque. "thread.doit(method)" == thread.execute_method_as_transaction(method).
JDASTM: txbegin, txend.
Survey included experience, hours, rankings
147 students
Hours reported:
single lane: coarse grained > tm > fine grain. They did coarse grained first.
Best syntax: coarse > (TM|Coarse) > fine > (fine|conditions)
Easiest to think about: coarse > fine|conditions > tm
Defects tested using condor.
Errors taxonomy:
---
Wants support for atomic blocks.
---
I asked if there were programmer visible abort actions - if there was contention. There was not.
AFG opinion: abort actions will be a source of errors. Hard to test. I like transactions, but I hate increasing non-determinism.
Audience Q: learning curve. Why not teach TM first, and then translate into locks?
I was surprised at syntax preference for coarse grained locks. IMHO txstart/txend is almost equivalent to lock/unlock coarse grained locks. The presenter was similarly puzzled.
Experiment: measure on a class of inexperienced programmers in a UT OS class.
The problem: sync gallery: a rogue's gallery of synchronization. Rogues shoot paint balls in lanes. Cleaners. Etc.
9 different variations: {single lane, two lane, cleaner thread} X {coarse, fine, TM}
TM support: Year1 DSTM2 (Herlihy 06). Year2 JDASTM (Ramadan 09). Library, not langage support.
DSTM syntax baroque. "thread.doit(method)" == thread.execute_method_as_transaction(method).
JDASTM: txbegin, txend.
Survey included experience, hours, rankings
147 students
Hours reported:
single lane: coarse grained > tm > fine grain. They did coarse grained first.
Best syntax: coarse > (TM|Coarse) > fine > (fine|conditions)
Easiest to think about: coarse > fine|conditions > tm
Defects tested using condor.
Errors taxonomy:
- lock ordering - 8%
- lock cond - 7%
- lock forgot - 15%
- cv exotic - 8%
- cv use - 11%
- tm exotic - 3%
- tm forgot ..
- tm order - not really a bug ..
---
Wants support for atomic blocks.
---
I asked if there were programmer visible abort actions - if there was contention. There was not.
AFG opinion: abort actions will be a source of errors. Hard to test. I like transactions, but I hate increasing non-determinism.
Audience Q: learning curve. Why not teach TM first, and then translate into locks?
I was surprised at syntax preference for coarse grained locks. IMHO txstart/txend is almost equivalent to lock/unlock coarse grained locks. The presenter was similarly puzzled.
Blogging from ISCA: WDDD: Emmett Witchel: Mondriaan-like
Wrote paper: lots of people need metadata. Mondriaan. Pixie dust.
Mondriaan is a general solution, but must be engineered to fit a specific problem.
Mukti-paper projects. Emphasize novelty. Features disappear because they didn't work; lack of space; lack of novelty.
Mondriaan gave metadata for each 32-bit word. No alignment restrictions. No warts.
MMP hardware: like page table. Perm Table Base. Perm Table. Protection Lookaside Buffer.
Mondriaan tradeoffs:
Space:
PLB refill costs: minimize refills / maximize reach.
SW overheads writing table entries: infrequent updates and/or simple table updates.
Mondriaan stored permissions data, but can handle arbitrary metadata.
Talk is something like a design rationale for Mondriaan. 2 bit permissions for each word. (Byte?) Run length encoded. Zones <= 4 for 16 words. Fallback to pointer to a bitmap entry.
(AFG: I'm not interested in zones. Bad security model. But the metadata mechanisms may be interesting.)
RLE made writes slow.
Mondrix wrote permissions table entries a lot. RLE made it slow. Fell back to using bitmap entries. Coarser grained protection. Page granularity.
Emmett walks through examples of other work using Mondriaan-like metadata.
Colorama. Luis Ceze HPCA 2007. Explicitly uses Mondriaan. Colors data structures.
Measured dynamic memory allocations (malloc) every 1,900 instructions.
Loki. OSDI 2008. All data has 32 bit security tag. Tags per page, tags per word.
Concusion:
Balance space, PLB reach, write overhead.
PLB reach neglected.
Measuring write overhead maybe too hard for research project: suggests counting, multiplying by a cost estimate.
Audience Q: Dave Christie. PLB coherency? A: Mondrix did not deal with.
Dave Christie of AMD (also of my high school) asked about single threaded coherency and multithreaded. It sounds like he has some familiarity with the issue.
I think that it is also interesting that David chose this talk to attend.
Colorama: Gabriel Loh, Luis Ceze, Emmett: not totally practical, but interesting. Luis: had some deadlocks, might need TM support as well.
Mondriaan is a general solution, but must be engineered to fit a specific problem.
Mukti-paper projects. Emphasize novelty. Features disappear because they didn't work; lack of space; lack of novelty.
Mondriaan gave metadata for each 32-bit word. No alignment restrictions. No warts.
MMP hardware: like page table. Perm Table Base. Perm Table. Protection Lookaside Buffer.
Mondriaan tradeoffs:
Space:
PLB refill costs: minimize refills / maximize reach.
SW overheads writing table entries: infrequent updates and/or simple table updates.
Mondriaan stored permissions data, but can handle arbitrary metadata.
Talk is something like a design rationale for Mondriaan. 2 bit permissions for each word. (Byte?) Run length encoded. Zones <= 4 for 16 words. Fallback to pointer to a bitmap entry.
(AFG: I'm not interested in zones. Bad security model. But the metadata mechanisms may be interesting.)
RLE made writes slow.
Mondrix wrote permissions table entries a lot. RLE made it slow. Fell back to using bitmap entries. Coarser grained protection. Page granularity.
Emmett walks through examples of other work using Mondriaan-like metadata.
Colorama. Luis Ceze HPCA 2007. Explicitly uses Mondriaan. Colors data structures.
Measured dynamic memory allocations (malloc) every 1,900 instructions.
Loki. OSDI 2008. All data has 32 bit security tag. Tags per page, tags per word.
Concusion:
Balance space, PLB reach, write overhead.
PLB reach neglected.
Measuring write overhead maybe too hard for research project: suggests counting, multiplying by a cost estimate.
Audience Q: Dave Christie. PLB coherency? A: Mondrix did not deal with.
Dave Christie of AMD (also of my high school) asked about single threaded coherency and multithreaded. It sounds like he has some familiarity with the issue.
I think that it is also interesting that David chose this talk to attend.
Colorama: Gabriel Loh, Luis Ceze, Emmett: not totally practical, but interesting. Luis: had some deadlocks, might need TM support as well.
Subscribe to:
Posts (Atom)