Full disclosure and integrity

I feel like I owe it to my readers to disclose a few things, due to the events of recent weeks raising a few questions in some people’s minds.

Read more

Microsoft’s temper tantrum

Microsoft is throwing a temper tantrum that if the states’ current proposal goes through, the company will be forced to withdraw Windows from the market.
Pay no attention, move along, there’s nothing to see here.

Remember, this is the company that didn’t sign an agreement with IBM for a Windows 95 OEM license until the day it was launched. At one point during the negotiations, Microsoft told IBM it could buy it at retail. As hard as it might be to remember now, at the time, IBM was still one of the top 5 players in the U.S. PC retail market.

This is a company that plays hardball. It says unreasonable things to get its way. And it’s used to getting its way. And even when it doesn’t get its way, it still says stupid things. Remember, in 1994 Steve Ballmer said a court’s decision against Microsoft in Stac’s favor would be reversed as soon as they found a judge with actual brains.

Reality check: Microsoft can very easily comply with the states’ demands. Or reach a compromise that will benefit everybody. Once upon a time, long long ago, when you installed Windows, you could tell it what you wanted. If you didn’t have any use for Calculator, you could click a little checkbox next to it, Windows wouldn’t install it, and you’d save about 200K of disk space. Hey, back when people were trying to run Windows on 40-meg hard drives, it was nice to have that ability. Or, if you already had a third-party calculator app that put Microsoft’s to shame and thus had no need for the one that came with Windows, you didn’t have to install it.

The same was true of DriveSpace and all the other bundled stuff. I mean, let’s get serious here: Is there any reason whatsoever to install Space Cadet Pinball on your domain controller?

But with Windows 95, Microsoft started to get unreasonable. Yes, you could uncheck that little box next to MSN, but when you did it, Windows didn’t actually seem to do anything. Regardless of whether you checked that box, when Windows was finished, you had an MSN icon on your desktop. If AOL continued to exist, Microsoft’s very existence was threatened. In order for Microsoft to survive, AOL had to die. So you got MSN whether you used it or not. (Some idiot with a journalism degree figured out how to remove it a couple of years later.)

With Windows 95B, things got more sinister. Netscape replaced AOL as the imminent threat to Microsoft’s very survival, so you got Internet Explorer whether you wanted it or not. This time, Microsoft didn’t even bother putting in a checkbox for Windows to ignore. You just got it. With Windows 95 OSR2.1 and 98, Internet Explorer became increasingly more entrenched.

Once it was evident that AOL would never die and Netscape would never rise again, RealPlayer and QuickTime became threats to Microsoft’s existence. So, with Windows 98, we got Microsoft Media Player, whether we wanted it or not. Never mind that the basic Real and QuickTime players are free and both companies would have loved for Microsoft to deliver them with Windows and it would have saved the company development costs.

Microsoft could go a long, long way towards appeasing the states if they’d just put in little checkboxes that let you decide whether Internet Explorer or MediaPlayer was installed, just like Calculator. There’s no need for 8,000 different versions of Windows, like Steve “The Embalmer” Ballmer wants people to believe. Let the consumer decide what pieces he or she wants. Does a deaf person need MediaPlayer? It’s questionable. Does a file server really need Internet Explorer? Absolutely not.

And while there are magazines and book authors who want you to believe otherwise, thousands of people have removed Internet Explorer from Windows. And guess what? The sun didn’t quit rising. The world failed to fall apart. The stock market didn’t crash. Their computers didn’t fall over. The applications they needed to run still ran. In fact, the applications ran better once they got the unnecessary machinery gone. Imagine that, a basic engineering principle applying to computers!

Microsoft execs have complained about a double standard, because Apple, IBM, and Be all shipped Web browsers with their OSs. Of course, there was a big difference. In the case of MacOS, BeOS, and OS/2, you could tell the OS not to install the browser, and it didn’t do it. The same for their other components. In the case of OS/2, you could even remove the entire Windows subsystem. You lost the ability to run Windows 3.1 programs, but you gained speed and stability. I knew people who did that. I’ve done minimalist Mac OS installations that took up less than 20 megs and were completely useless because they lacked the drivers needed to install other software. But if I want to be stupid enough to install a completely crippled OS that can’t do anything besides boot a computer and let me look at its empty hard drive, Apple’s not going to stop me.

The overwhelming majority of people will just leave things alone. But the people who like to get into the nuts and botls of things want (and deserve) the opportunity to change how their computers work. They want Microsoft to fight its battles in the marketplace, not in the memory and CPUs of their computers. I don’t blame them in the least. Of course, I’m spoiled. IBM and Commodore let me have it my way, back when I was buying my operating systems from them.

So, Microsoft has a history of threats, and a history of following through with them, even when the reasoning behind them is totally ludicrous. But in the case of IBM, they ultimately budged, albeit 45 minutes into the 11th hour, and they didn’t budge much. But you don’t just shut out the #3 or #4 PC maker in the country. At the time, Microsoft still needed IBM, and IBM needed Microsoft, as much as both companies hated to admit it.

This is no different. Microsoft can’t just pull Windows off the market. Windows is still its main source of revenue, and Windows runs on more than 90 percent of the computers on the market. Microsoft isn’t going to just give that away. Sure, they make some Mac products, but the Mac is 5 percent of the market on a good day. The cheapest and easiest replacement for Windows, in the unlikely event Microsoft pulled out, is Linux, where Microsoft is a non-player. Microsoft could still sell Windows software to the existing installed base. But it’s ludicrous. Pulling Windows off the market is corporate suicide.

I really don’t think Microsoft would have made IBM buy its copies of Windows 95 at retail. Not everyone remembers it now, but there was some resistance to Windows 95 initially, and a company the size of IBM not shipping Windows 95 on its new computers would have given way to much credence to the naysayers. Microsoft was counting on Windows 95 being big, and it wasn’t going to take any chances. It had spent way too much money on research, development, and hype. Microsoft made that threat to see just how far IBM would go. And that’s what Microsoft is doing now. It’s trying to see how much the states are going to budge.

And that’s all there is to Ballmer’s rhetoric. Nothing more. And nothing less.

Another RISC platform for Linux

Vintage workstations. I’ve read two articles this past week about running Linux or another free Unix on vintage hardware.
http://www.debianplanet.org/article.php?sid=605
http://www.newsforge.com/article.pl?sid=02/02/19/049208&mode=thread

And while I can certainly appreciate the appeal of running a modern free Unix on a classic workstation from the likes of DEC or Sun or SGI, there’s another class of (nearly) workstation-quality hardware that didn’t get mentioned, and is much easier to come by.

Apple Power Macintoshes.

Don’t laugh. Apple has made some real dogs in the past, yes. But most of their machines are of excellent quality. And most of the appeal of a workstation-class machine also applies to an old Mac: RISC processor, SCSI disk drives, lots of memory slots. And since 7000-series and 9000-series Macs used PCI, you’ve got the advantage of being able to use cheap PC peripherals with them. So if you want to slap in a pair of 10,000-rpm hard drives and a modern SCSI controller, nothing’s stopping you.

There’s always a Mac fanatic out there somewhere willing to pay an exhorbinant amount of money for a six-year-old Mac, so you won’t always find a great deal. Thanks to the release of OS X (which Apple doesn’t support on anything prior to the Power Mac G3, and that includes older machines with G3 upgrade cards), the days of a 120 MHz Mac built in 1996 with a 500-meg HD and 32 megs of RAM selling for $500 are, fortunately, over. Those machines run Linux surprisingly well. Linux of course loves SCSI. And the PPC gives slightly higher performance than the comparable Pentium.

And if you’re lucky, sometimes you can find a Mac dirt-cheap before a Mac fanatic gets to it.

The biggest advantage of using a Mac over a workstation is the wealth of information available online about them. You can visit www.macgurus.com to get mainboard diagrams for virtually every Mac ever made. You can visit www.everymac.com for specs on all of them. And you can visit www.lowendmac.com for comprehensive write-ups on virtually every Mac ever made and learn the pitfalls inherent in them, as well as tips for cheap hardware upgrades to squeeze more speed out of them. I learned on lowendmac.com that adding video memory to a 7200 increases video performance substantially because it doubles the memory bandwidth. And on models like the 7300, 7500, and 7600, you can interleave the memory to gain performance.

Besides being better-built than many Intel-based boxes, another really big advantage of non-x86 hardware (be it PowerPC, Alpha, SPARC, MIPS, or something else) is obscurity. Many of the vulerabilities present in x86 Linux are likely to be present in the non-x86 versions as well. But in the case of buffer overflows, an exploit that would allow a hacker to gain root access on an Intel box will probably just crash the non-x86 box, because the machine language is different. And a would-be hacker may well run into big-endian/little-endian problems as well.

http://homepages.ihug.com.au/~aturner/7200boot.html

Linkfest Friday…

Let’s start things off with some links. Web development’s been on my mind the last few days. There’s a whole other world I’ve been wanting to explore for a couple of years, and I’ve finally collected the information that’ll let me do it.
Redirecting virus attacks — Your neighbor’s got Nimda? Here’s how to get his IIS server to quit harassing your Apache server. (Suggests redirecting to a bogus address; I’m inclined to redirect either to 127.0.0.1 or www.microsoft.com, personally.)

DJG’s help setting up MySQL. Apache, MySQL and PHP are a fabulous combination, but bootstrapping it can be a painful process. People talk about writing a sendmail.cf file as their loss of innocence, but I’ve written one of those and I’ve tried to set up the LAMP quartet. The sendmail.cf file was easier because there’s a whole lot more written about it.

Short version: Use Debian. Forget all the other distributions, because they’ll install the pieces, but rarely do they put the conduits in place for the three pieces to talk. It’s much easier to just download and compile the source. If that doesn’t sound like fun to you, use Debian and save some heartache. If you’re stuck with the distro you have, download ApacheToolbox and use it. You’ll probably have to configure your C/C++ compiler and development libraries. That’s not as bad as it sounds, but I’m biased. I’ve compiled entire distributions by hand–to the point that I’ve taken Linux From Scratch, decided I didn’t like some of the components they used because they were too bloated for me, and replaced them with slimmer alternatives. (The result mostly worked. Mostly.) You’ve gotta be a bit of a gearhead to take that approach.

Debian’s easier. Let’s follow that. Use this command sequence:

apt-get install apache
apt-get install php4-mysql
apt-get install mysql-server

Next, edit /etc/apache/httpd.conf. There’s a commented-out line in there that loads the php4 module. Uncomment that. Just search for php. It’ll be the third or fourth instance. Also, search for index.html. To that line, add the argument index.php. If you make index.php the first argument, access to PHP pages will be slightly faster. Pull out any filetypes you’re not using–if you’ll never make an index page called anything but index.html or index.php, pull the others and Apache will perform better.

Got that? Apache’s configured. Yes, the php installation could make those changes for you. It doesn’t. I’m not sure why. But trust me, this is a whole lot less painful than it is under Red Hat.

But you’re not ready to go just yet. If you try to go now, MySQL will just deny everything. Read this to get you the rest of the way.

Once you’ve got that in place, there are literally thousands of PHP and PHP/MySQL apps and applets out there. If you can imagine it, you can build it. If HTML is a 2D world, PHP and MySQL are the third and fourth dimension.

Am I going to be playing in that world? You’d better believe it. How soon? It depends on how quickly I can get my content whipped into shape for importing.

This is the holy grail. My first editing job was doing markup for the Digital Missourian, which the faculty at the University of Missouri School of Journalism believe was the first electronic newspaper (it came into being in 1986 or so). By the time I was working there in the late summer of 1995, it had been on the ‘Net for several years. About eight of us sat in a room that was originally a big storage closet, hunched in front of 486s, pulling stories off the copydesk, adding HTML markup, and FTPing them to a big Unix cluster on the MU campus. We ran a programmable word processor called DeScribe, and we worked out some macros to help speed along the markup.

No big operation works that way anymore. There aren’t enough college students in the world. You feed your content to a database, be it Oracle or IBM DB2 or Microsoft SQL Server or MySQL or PostgresSQL. Rather than coding in straight HTML, you use a scripting language–be it PHP or ASP–that queries the database, pulls the content, applies a template, and generates the HTML on the fly. The story goes from the copy editor’s desk to the Web with no human intervention.

There are distinct advantages to this approach even for a small-time operation like me. Putting the content in a database gives you much more versatility. Some people want overdesigned Web sites. Some want something middle-ground, like this one. Others want black text on a gray background like we had in 1994. You can offer selectable formats to them. You can offer printer-friendly pages. You can even generate PDFs on the fly if you want–something some sites are doing now in an effort to gain revenue. If you have content from various sources, you can slice and dice and combine it in any imaginable way.

I can’t wait.

How Linux could own the education market

How Linux could own the education market. I spent some time yesterday evening working on computers. They were contrasts to the extreme: One, a brand-spankin’ new 1 GHz AMD Duron system with 512MB of RAM and 80 GB of 7200-rpm storage (IDE, unfortunately–but for $800, what do you want?). The other was an elderly AST 486SX/25 running Windows 3.1 belonging to a local teacher who goes to my church.
She teaches kindergarten, and the AST used to be her home computer. When she bought a Compaq Presario a couple of years ago, she took the AST to school. It’s more useful there than in her basement, and there’d be no computer in her classroom if it weren’t for that.

I don’t understand why that is. As much as my sister jokes about it, we don’t exactly live in the ghetto. The school district has money, but it isn’t spending it on computers. Whether that’s a good or bad thing depends on your point of view. The majority of people living in Oakville probably own home computers, so this probably isn’t contributing to the technology gap. But I wonder sometimes how things might have been if I’d been exposed to computers a few years earlier.

I was shocked how much I remembered about Windows 3.1. And I was able to figure out how to get her CD-ROM drive to play music CDs. Don’t ask me how; this was the first I’d messed with Windows 3.1 since 1994 and I’d prefer it stay that way–I was so impressed by Windows 3.1 that I’m one of the 12 people who actually went out and paid money for OS/2. I own actual, retail-box copies of OS/2 2.1, 3.0, and 4.0. And I remember distinctly thinking that her computer has enough memory to run OS/2 at least as well as it runs Windows 3.1…

I also remember distinctly thinking that my employer pays someone $15 a pound to haul better computers than hers away several times a year. We regard 486s as junk; low-end Pentiums may also go out, depending on whether the right person finds out about them beforehand. Usually they work just fine–the problem isn’t the computers, it’s people trying to run Internet Exploiter 6 and Office 2000 on them. They’d run Windows 95 and Office 95 perfectly fine.

But a lot of times we can’t give these old computers away because the licenses for the software that originally came with them are long gone. Old computers are useless without software, so no one would want them anyway.

Now, let me tell you something about kids. Kids don’t care much about the computers they use. As long as there’s software on them, they’ll use them. When I was a kid 20 years ago, I used Radio Shack TRS-80 computers at school. The next year, my family moved, and my new school had Commodore 64s. I couldn’t tell much difference. My next-door neighbor had a Radio Shack Color Computer. They were computers. The Commodores had better graphics, but from a usability standpoint, the biggest difference was where the cartridge slot was so you could change programs. Later on I took a summer class at the local junior college, learning about Apple IIs and IBM PCs. I adjusted smoothly. So did all the other kids in the class. Software was software.

Kids don’t care if the computer they’re using runs Windows or Mac OS or Linux. All they care about is whether there are cool programs to run.

So, businesses throw useless computers away, or they give useless computers to schools so they don’t have to pay someone to haul them away. And schools don’t generally know what to do with obsolete computers that lack software.

Linux won’t run fabulously on old 486s, but Debian with a lightweight window manager like IceWM will run OK. (Let’s face it, Windows 3.1 doesn’t run fabulously on them either–it crashes if you breathe wrong.) I know of a project to clone Oregon Trail on Linux. Great start. How about Sea Route to India? I remember playing that on C-64s at school. It may have been a type-in out of a magazine–I don’t remember where exactly it came from. In these violent times, Artillery might be too controversial, but it taught us early on about angles and forces. Artillery was an ancestor to games like Scorched Earth, but without the heavy-duty nukes. Close wasn’t good enough to win in Artillery. You had to be exact. And no blowing up the mountains between you and your opponents either. You had to figure out how to get over them.

But what about doing homework? By the time I was in the sixth grade, they were teaching us how to use word processors and databases and spreadsheets. AbiWord is a fabulous lightweight word processor. It gives you fonts and spell-checking and good page formatting. (I learned word processing on Bank Street Writer. AbiWord is a far, far cry from that. Frankly, I’d rather write a paper with vi than with Bank Street Writer.) Besides being feature-rich, AbiWord’s been lightning fast on every computer I’ve tried it on. Gnumeric is a nice, fast, capable spreadsheet. I don’t know of a free-form database, but I haven’t looked for one lately either. (I don’t think we need to be trying to teach our 6th graders SQL.)

But what about for younger kids? I remember a program called The Factory. The object was you combined chemicals to make monsters. Different chemicals made different monsters. I seem to remember you played around to see what chemicals would make which heads and torsos and arms. Then the computer started showing you monsters and you had to figure out what chemicals to give it to match them. I also remember a program called Snooper Troops. I don’t remember much else about it, other than it was a mystery and you went around looking for clues, and one of my classmates accidentally formatted the disk one day before any of us had managed to solve it. We couldn’t get the disk replaced, because it was out of print.

And Spinnaker had all sorts of simple titles for younger kids that let them tell stories and other stuff. It seemed cool at the time. But that was almost 20 years ago, so about all I remember was that sailboat logo and some corny theme music.

The other thing about those old days was that the majority of these programs were written in Basic. An ambitious teacher could modify them, to make them easier or harder, or improve the graphics a little. As we got older and learned to program, some of us would try our hand at making changes. You can’t do that anymore with Windows or Macintosh educational titles. Open source can bring all that back too, provided the programs are written in languages like Perl or Python. And it can give cash-strapped schools a way to get computers where kids can use them.

Now I’m wondering what it would take to write something like The Factory in Python…

Why Linux stands a chance

Something I read on LinuxToday on Monday made me realize something. The article was a tutorial on writing Gnome apps with Python. Not too exciting, right? Not until you realize the implications. Python is a high-level, interpreted language. Gnome produces good, professional-looking applications with Windows-like functionality like toolbars and menus and drag-and-drop.
Put two and two together. Remember the early days of computing, when practically everyone who owned one knew how to program, at least a little bit? We’d program our 8-bit microcomputers in Basic, and sometimes we’d come up with something cool. You might send your creation off to a magazine in hopes of them publishing it and sending you a little money — a friend growing up and I netted a cool $350 on a little hack we wrote over spring break one year. Other times you just uploaded your creation to a BBS, hoping that people would find it useful, and maybe someone would download it and improve it a little. IBM was big and unstoppable, and Apple made the wise decision to flood the schools with cheap hardware in hopes of making it up by selling overpriced hardware to homes and businesses (which they did), but the homebrew market kept Commodore afloat for 10 years after their last good marketing decision. The cost of entry was low, and an easy-to-learn programming language was built right in, so creative minds could start playing with it without spending hundreds or thousands of dollars on development tools and thousands of dollars going to class.

The results weren’t always professional, but a surprising amount of it was exceptionally high-quality. High enough to sell more machines. Today, some 20 years after the Commodore 64 was released, it still has a following. It’s insane.

I still think that was part of what killed the Amiga. There were free languages for it, but you had to fork over a few hundred bucks for the toolkit to make them work. A lot of people did, but not enough. The development community was small. Some of the best stuff I saw on that platform came from people who pirated the toolkit. But not enough people did, so the pool of people to learn and steal tricks from was tiny. Meanwhile, Microsoft was selling complete languages, with everything you needed, for less than Commodore was charging for its header files. The Amiga never stood a chance.

Linux and other open-source projects collectively give you a free operating system or five, but they also give hundreds of development tools. The end result is Web sites like Freshmeat that do nothing but track new software. There may be more graphical Linux freeware out there now than there is Windows freeware. Considering Linux has maybe 1/50 the installed base of Windows, that’s pretty impressive. Linux doesn’t have a killer app just yet, but it may come. It’s definitely not short of ideas. Just this past week, someone released a hack for the Nautilus file manager to make it read binary newsgroups. It reads them and is intelligent enough to group related binaries in subdirectories for you. It’s a file collector’s delight. Brilliant idea. I’ve never seen anything like that for any other OS, especially not Windows.

Free languages lower the bar. Free and capable high-level languages lower the bar even more. Even a non-programmer like me can have an idea, hack out something in Python, and even if it doesn’t work perfectly, it can serve as a springboard for someone else to grab and improve, either by revising the existing code or by translating it into a lower-level, faster language. The quality of the code isn’t nearly as important as the quality of the idea. And we all know programmers don’t have a monopoly on good ideas.

Maybe Linux will remain an underground, punk OS forever. But even if it does, it’s going to be an unbelievably good one. Look for it to be bigger than the Mac within two years.

Linux on a Power Mac 7500

I built a Linux box earlier this week. There was a Power Mac 7500 at work that was begging for a conversion. Actually it’s a classic Hackintosh, assembled from the pieces of a 7500 and a dead 7600, so it’s running at 133 MHz instead of its original 100 MHz, and with 128 megs of interleaved EDO RAM. And it’s SCSI. So it had plenty of memory, a server-grade disk, and a RISC-based CPU. I had to see what it could do once it was unencumbered by the Mac OS GUI.
I chose Debian, because Debian installs very little extraneous garbage and because it’s super-simple to maintain.

And I’ll never complain about the difficulty of installing Linux on a PC again. Not that I’ve complained in a really long time, but Linux on an old Mac is a pain.

It’s nearly impossible to make these old Macs boot Linux directly, so you do a dual-boot trick, installing MacOS and then installing BootX, which is a control panel that pops up early in the boot process and asks you what OS you want. The default is Linux. Pick Linux, or let it time out, and that annoying smiling guy disappears, replaced by the glorious text-mode (bet you didn’t know the Mac had one of those, did you?) screen of the Linux boot process. Oh yeah, there’s a smiling picture of Tux up in the right-hand corner while it’s all going on. It’s a cool Wizard of Oz-like effect, I think.

So you boot off your MacOS CD, make yourself a 20-meg Mac partition, install just the base OS and the multimedia stuff, which includes the Apple CD/DVD-ROM driver–I didn’t realize that wasn’t part of the base OS and was wondering why I couldn’t read CD-ROMs anymore. Then search the CD for Stuffit Expander and Disk Copy. You’ll need those too. The version of Stuffit that came bundled with MacOS 8.5 couldn’t do anything with BootX on the Debian CD, so you’ll need to find a newer version on another Mac and then sneakernet it over. Then you use Disk Copy to generate images of the boot and root CDs. Drop BootX in System Folder::Control Panels, drop the Debian Kernel in the Linux Kernels subfolder of the System Folder, insert your Debian CD, then boot off the floppies, and you’re ready to go.

Apple hardware–old Apple hardware at least–is generally pretty reliable, so if you’ve got ancient Macs at work you need to put to something useful, this is a good way to do it. They’ll give better file server performance than a Snap server and you can even do software RAID configurations. Old desktop Macs have two 3.5″ bays, so you can mirror disks, and there is an external SCSI port for expansion if you want to do other types of RAID or connect a tape drive. And they’d make great intranet servers.

What did I do with the Mac? I made it into a PDF server. It’s great. I print to the phantom printer, and PDFs pop up in its file share. It’s lightning fast–by the time I pop over to the share to pick up the file, the server’s had enough time to create the PDF. So this 133 MHz Mac running Linux can generate PDFs in less time than it would take to print the file. I had problems with the GNU Ghostscript package (gs), so I ended up having to use Aladdin Ghostscript (aladdin-gs) instead. No big deal to me, since I’m not a GNU bigot.

I tried to make the service available to the Macs on the network too, by installing netatalk, but the phantom printer doesn’t work right. I’m still hoping to resolve that. Making shares with netatalk is frighteningly simple, but making printers with it is less fun than configuring XFree86 by hand.

Even with the difficulties, Charlie and I had it working well for Windows clients in a couple of hours. I think it was a good investment of a couple of hours, taking a computer off the scrap heap and making something useful out of it without having to buy any software.

More on video editing

Last night I found myself watching some old documentaries my Dad had on VHS (mostly episodes of old Discovery channel series, circa 1990), as much to watch how they used footage from varying sources and how they handled voiceovers as for the information they were presenting–although the subject matter was something I find interesting. It’s much easier to deal with poor quality old footage today than it was then–what I’d try to do is digitize it into Premiere, then export it to a Photoshop filmstrip, then export that into PhotoDeluxe and use its automatic cleanup, then take it back into Photoshop and then back to Premiere. The result wouldn’t be perfect but in five minutes you could have a film clip that looks a lot better.
I’m not sure I can ever watch TV for enjoyment ever again–I find myself analyzing it, trying to figure out how I’d do something comparable, or better. Then again, aside from baseball games, I haven’t watched TV for enjoyment with any regularity since 1992 when Quantum Leap went off the air, so I don’t think my new hobby changes anything.

My next video project is a documentary. I won’t be spending much time behind the camera; I’m putting my journalist hat back on and doing the interviews. I don’t know yet if I’ll be the one assembling and arranging the clips. The challenges here are really different from my music video projects, but I don’t see it as being very different from my old magazine projects in college. The biggest difference is that now I can add audio to help tell the story, and the pictures can move. But it’s still a matter of gathering the story, then gathering elements that help tell the story.

This is a big change for me though. In Journalism 105–the second journalism class I ever took–they exposed us to the basics of all the major forms of journalism: newspaper, magazine, advertising, radio, and television. I learned how to write a basic, straight news story in high school, so newspaper writing was easy. Magazine writing appealed to me a bit more because you could get more creative. Radio was a nice challenge, because you had very limited space to tell the story since it would be read aloud. Advertising was the most different unit but I didn’t struggle with it too much, at least not in that class. The only unit I disliked was the TV unit, because I didn’t like storyboarding. I think I know what changed though. When I learned TV writing, we were still in the linear era. Non-linear editing systems existed, but they weren’t widespread, so that wasn’t what they taught us.

Fast-forward six years. A couple of media professionals in St. Louis taught me how to use Apple’s Final Cut Pro. I was competent in an afternoon. To me, it looked almost like desktop publishing software, the biggest difference being that final output was playback, rather than a printed page. Suddenly TV made sense, and I caught myself thinking I’d like to go back to journalism school and get a broadcast degree. Sanity quickly returned.

Video resources online. I’m going to let the cat out of the bag. The biggest obstacle to learning video editing is a lack of footage to work with. Sure, if you’ve got a DVD-ROM drive, you can rip video from DVD and use it, but then you can’t legally use the result for anything unless you go get the appropriate permissions. You want to get permissions before you start on a project, but you don’t want to wait around for permission before you start getting your hands dirty. The answer is to mess around with some public domain video. Then you can do anything you want.

The lowdown: Anything produced in the United States before 1922 is now public domain. This includes video, photos, and music–although a specific recording can be protected by separate copyright. As a general rule, it’ll be 2067 before you see widespread public domain music recordings. Anything produced by the U.S. Government, whether in 1776 or five minutes ago, is public domain. And a large number of works produced since 1922 have fallen into the public domain for one reason or another–the most noteworthy example being the movie “It’s a Wonderful Life.” If you’ve ever wondered why 800 of your 922 cable channels, seemingly including ESPN, C-SPAN and the Cartoon Network, are showing that movie at any given moment in December, that’s why–any TV station can play that movie without paying anyone a dime.

Public domain video or stills can also be useful if you’re in the middle of a project and need to illustrate a point and none of your sources (whether your own video or other video you’ve obtained permission to use) illustrate it adequately.

Finding public domain stuff is a little harder. So here’s a core dump of all the resources I’ve found in the last couple of days:

http://www.pdinfo.com — public domain music
Links page from above, includes other media
The Internet Archive’s Movie Collection, over 950 downloadable PD movies, mostly short informational or promotional pieces.
Rick Prelinger’s journal, related to the above collection.
Kino International, a distributor of old movies on VHS and DVD, some of which is in the public domain.
Retrofilm.com, a distibutor of public domain material on professional-grade media such as miniDV–they don’t sell material on VHS or DVD. Their catalog is surprisingly large and recent, including a 1980 made-for-TV movie about Jonestown that I remember seeing at least twice.
Tips for handling files from The Internet Archive Collection on various platforms
The Public Domain: How to find and use copyright-free writings, music, art and more, a 300-page book on the subject.

Tools. There’s a non-linear editing project for Linux called Broadcast 2000 that got rave reviews, but unfortunately, DMCA-related litigation caused development of the program to be halted (presumably because of fear of lawsuits, either due to liability or due to people possibly using the program to violate the DMCA) and the developer no longer offers it for download. I did find the source code on Tucows, and recent versions of SuSE and Mandrake are supposed to have it. Since the program was GPL, you can still legally download it and do whatever you want with it. GIMP was abandoned by its original authors early in its development cycle and subsequently picked up by others, so maybe Broadcast 2000 still has a future.

I found some Broadcast 2000 tips here.

Regardless of what tools you use for editing, be sure to get Virtual Dub–do a search on Google. You can use it to crop your video clips and convert between formats. I’ve had good results using the Indeo 5.1 codec at a high quality setting. Slice the video you want to use into the segments you want, leaving yourself a few frames on either side just in case you need to stretch the sequence out or decide you want to use transitions.

More perspective on video editing

I read Bill Machrone’s current PC Magazine column on PC non-linear video editing with a bit of bemusement. He talked about the difficulty he and his son have editing video on their PCs, and he concluded with the question: “How do normal people do this stuff?” and the misguided answer: “They buy a Mac.”
You don’t have to do that. In fact, you can do pretty well on a PC if you just play by the same rules the Mac forces you to play by.

Consider this for a minute: With the Mac, you have one motherboard manufacturer. Apple tends to revise its boards once a year, maybe twice. Apple makes, at most, four different boards: one for the G4 tower systems, one for the iMac, one for the iBook, and one for the PowerBook. Frequently different lines will share the same board–the first iMacs were just a PowerBook board in an all-in-one case.

And the Mac (officially) supports two operating systems: the OS 9 series and the OS X series. You keep your OS at the current or next-most-recent level (always wait about a month before you download any OS update from Apple), and you keep your apps at current level, and you minimize compatibility problems. Notice I said minimize. PageMaker 7 has problems exporting PDF documents that I can’t track down yet, and I see from Adobe’s forums that I’m not the only one. So the Mac’s not always the bed of roses Machrone’s making it out to be.

Now consider the PC market for a minute. You’ve got two major CPU architectures, plus also-ran VIA; 4-6 (depending on who you ask) major suppliers of chipsets; at least four big suppliers of video chipsets; and literally dozens of motherboard manufacturers. Oh, you want an operating system with that? For all the FUD of Linux fragmentation, Microsoft’s in no better shape: Even if you only consider currently available offerings, you’ve got Windows 98, ME, NT4, 2000, and two flavors of XP.

So we go and we buy a video capture card and expect to put it in any old PC and expect it to work. Well, it probably ought to work, but let’s consider something. Assuming two CPU architectures, four chipset manufacturers, four video architectures, and twelve motherboard manufacturers, the chances of your PC being functionally identical to any other PC purchased right around the same time are 1 in 384. The comparable Mac odds: 1 in 4. But realistically, if you’re doing video editing, 1 in 1, because to do serious video work you need a desktop unit for its expandability. No Blue Dalmation browsing for you!

So you can rest assured that if you have a Mac, your vendor tested the equipment with hardware functionally identical to yours. On a PC you just can’t make that assumption, even if you buy a big brand name like Dell.

But you want the best of both worlds, don’t you? You want to play it safe and you want the economy of using inexpensive commodity PC hardware? It’s easy enough to do it. First things first, pick the video editing board you want. Next, visit the manufacturer’s Web site. Pinnacle has a list of motherboards and systems they’ve tested with the DV500, for instance. You can buy one of the Dell models they’ve tested. If you’re a do-it-yourselfer like me, you buy one of the motherboards they’ve tested. If you want to be really safe, buy the same video card, NIC, and SCSI card they tested as well, and plug them into the same slots Pinnacle did. Don’t worry about the drives Pinnacle used; buy the best-available SCSI drive you can afford, or better yet, two of them.

Video capture cards are cranky. You want a configuration the manufacturer tested and figured out how to make work. Otherwise you get the pleasure. Or the un-pleasure, in some cases.

As far as operating systems go, Windows 2000 is the safe choice. XP is too new, so you may not have drivers for everything. 98 and ME will work, but they’re not especially stable. If I can bluescreen Windows 2000 during long editing sessions, I don’t want to think about what I could do to 9x.

And the editing software is a no-brainer. You use what comes with the card. The software that comes with the card should be a prime consideration in getting the card. Sure, maybe an $89 CompUSA special will do what you want. But it won’t come with Premiere 6, that’s for certain. If I were looking for an entry-level card, I’d probably get a Pinnacle DV200. It’s cheap, it’s backed by a company that’ll be around for a while, and it comes with a nice software bundle. If you want to work with a variety of video sources and output to plain old VHS as well as firewire-equipped camcorders, the DV500 is nice, and at $500, it won’t break the bank. In fact, when my church went to go buy some editing equipment, we grabbed a Dell workstation for a DV500, and we got a DV200 to use on another PC in the office. The DV200-equipped system will be fine for proof of concept and a fair bit of editing. The DV500 system will be the heavy lifter, and all the projects will go to that system for eventual output. I expect great things from that setup.

The most difficult part of my last video editing project (which is almost wrapped up now; it’s good enough for use but I’m a perfectionist and we still have almost a week before it’ll be used) was getting the DV500’s video inputs and outputs working. It turned out my problem was a little checkbox in the Pinnacle control panel. I’d ticked the Test Video box to make sure the composite output worked, back when I first set the board up. Then I didn’t uncheck it. When I finally unchecked it, both the video inputs and outputs started working from inside Premiere. I outputted the project directly to VHS so it could be passed around, and then for grins, I put in an old tape and captured video directly from it. It worked. Flawlessly.

One more cavaet: Spend some of the money you saved by not buying a Mac on memory. Lots of memory. I’m using 384 MB of RAM, which should be considered minimal. I caught myself going to Crucial’s Web site and pricing out three 512-meg DIMMs. Why three? My board only has three slots. Yes, I’d put two gigs of RAM in my video editing station if I could.

OK, two more cavaets: Most people just throw any old CD-ROM drive into a computer and use it to rip audio. You’ll usually get away with that, but if you want high-quality samples off CD to mix into your video production, get a Plextor drive. Their readers are only available in SCSI and they aren’t cheap–a 40X drive will run you close to $100, whereas no-name 52X drives sometimes go for $20-$30–but you’ll get the best possible samples from it. I have my Plextor set to rip at whatever it determines the maximum reliable speed may be. On a badly scratched CD sometimes that turns out to be 1X. But the WAV files it captures are always pristine, even if my audio CD players won’t play the disc anymore.

Wrapping up a week…

Someone at Google has a sense of humor. See (or should I say 533?) for yourself.
Dan Bowman sent me the link. My response?

+#4+ !$ $0 k3wl! +#4nk$!

Desktop video. I still can’t get my Pinnacle DV500’s composite inputs to work right. The rest of the card seems to function just fine. As a workaround, I tried connecting a DVD-ROM drive and ripping the source video digitally, straight off the DVD. I was able to get decoded .VOB files to the drive, but the utilities to convert them into usable AVI files (Premiere won’t work with VOBs) all had an annoying tendency to crash. At one point I suspected I had a binary compiled for Intel systems, and obviously my AMD CPU won’t like those SSE instructions. So I copied a single 1-gig VOB file over to a P3-based laptop. The utility got a little further, but it still crashed.

And yes, incidentally, I did secure permission from the copyright holders to use their video. As for the legality of what I did in the DMCA era, one of the utilities looked at the DVD and said it was unprotected. It’d be hard to prosecute me for circumventing copy protection when none existed in the first place.

I was going to say we’ve come a long way since Amigas and Video Toasters, but I’m not going to say that. Amigas and Video Toasters actually worked.

Tribute. How’d I forget this? The Silent Beatle died Thursday. Unless you’ve been living in a cave, you already knew that.

The radio station I listen to most often, which can’t decide whether it wants to be a retro station, a New Wave station, a hair band station, or an Adult Alternative station, stepped way outside its format and did a nice Beatles tribute Friday at lunch, playing an hour’s worth of tunes, ending with “The Long and Winding Road,” which seemed eerily appropriate.

I remember when the Beatles boxed set came out a few years ago. I was still in college, and my next-door neighbor, Chip, got it the first day. He and I watched the corresponding TV special, and I remember someone walking in and saying he didn’t know any Beatles songs. I told him he was crazy. The Beatles are so pervasive, I said, that they’re not even just part of our culture anymore. They’re part of our DNA.

So Chip reached over and turned on his CD player and flipped through a few selections. A look of recognition came over his face to most of them. Yeah, he knew some Beatles songs. He’d just never recognized them as Beatles songs. Even young whippersnappers like us knew them and loved them.

The Beatles were history years before I was born, and for that matter, by the time I was born in 1974, even their record label, Apple Records, was in shambles. I have no recollection of the day John Lennon was murdered. The earliest Beatles memory I had growing up was hearing George Harrison’s “I’ve Got My Mind Set on You” on the radio and seeing the video on TV, in 1986. It was a good tune. Not as good as the best stuff he wrote, and it’s largely forgotten today, but what other songs from 1986 do people remember today? Bon Jovi? Puh-lease. It was such a bad year for music that The Police were able to remake their 1981 hit, “Don’t Stand So Close to Me,” and score a minor hit with it. Compared to the other choices we had that year, George Harrison scratching his nails down a blackboard for three minutes would have been cooler, just because it was George Harrison.

And he and the rest of his bandmates knew that. That was cool, because it freed them to experiment. So they had that stack of bubblegum pop hits in the early 60s that everyone remembers today, but in addition to that, they had their psychedelic period and by 1968 they had dabbled in everything else imaginable. Heavy metal? They did some of that. Industrial rock? They even did some of that. When it came to rock’n’roll, The Beatles tried everything. Everything that’s happened since has just been further exploration of territory they already covered.

George Harrison’s last few years weren’t pleasant ones, due to his battles with cancer and with deranged fans. I hope he’s happier now. I can’t imagine him doing anything else but sitting somewhere, making music with John Lennon, waiting for Paul and Ringo to show up.