LisaList2

Advanced search  

News:

2022.06.03 added links to LisaList1 and LisaFAQ to the General Category

Pages: 1 [2]   Go Down

Author Topic: ESProfle Image Management?  (Read 12143 times)

stepleton

  • Sr. Member
  • ****
  • Karma: +146/-1
  • Offline Offline
  • Posts: 479
Re: ESProfle Image Management?
« Reply #15 on: April 16, 2025, 04:05:25 am »

It's just that this is a pretty massive project, and I think it would be a lot more exciting to reveal it all at once at an event like this than to reveal it piece by piece along the way.

I have to say that I'm unmoved. Filesystem discoveries are of such basic utility to Lisa enthusiasts that big-presentation glory for one particular project (however famous) doesn't really justify keeping the secret in my book, at least not for a patch that I expect amounts to changing a single-digit number of bytes. (It will be interesting to know if that hypothesis is correct!) Other people may have other projects they want to accomplish on their machines, and in my own opinion it's better for everyone if they don't have to wait for such a fundamental enhancement.

I assume that patching the ProFile driver is a relatively small part of your efforts. If that's correct, and if wanting to "be there first" is part of your motivation, I wouldn't overestimate the number of people with the will and the patience to try and accomplish the "hard part", which is to build the Office System and its tools. Who knows, but I would expect that a lot of people have other designs on their free time between now and June.

But let's say that you did get scooped because someone else gets their hands on a big ProFile: the worst-case scenario! Maybe they will get some story-of-the-day fame on hackaday and hacker news or something. You're still the one who's going to show all your work to an excited crowd at VCF; you'll be filmed and people are going to be able to ask you questions and talk to you in person. You know the deep lore and the technical details, and your care to share your knowledge (eventually  :) ) suggests to me that your work will wind up as the primary reference for how to do it.

You were not the first person to make a ProFile emulator, but ESProFile is now celebrated as one of the best and most accessible options out there, and rightly so. I expect the same outcome for your current project even if you aren't the first across the line. (Although I suspect you will be regardless.)

Big ProFile Technique is your discovery and so the knowledge is yours to do with as you wish, for now. But I may get a wild hair someday and try to figure it out for myself, and if I do, I will remain tempted to tell everyone how to do it. I'm still pretty busy, though. Maybe it's this evening that I'll finally get time to test those Monitor ProFile images...
Logged

Lisa2

  • Administrator
  • Sr. Member
  • *****
  • Karma: +77/-0
  • Offline Offline
  • Posts: 184
  • See why 1983 was more like Y2K...
    • Lisa2.com
Re: ESProfle Image Management?
« Reply #16 on: April 16, 2025, 10:39:50 am »

...ESProFile is now celebrated as one of the best and most accessible options out there...

ESProFile "one of the best" What?  Says who?  It's works and it's CHEAP.  Does cheap automatically make is the best?  I don't agree. 
Logged

stepleton

  • Sr. Member
  • ****
  • Karma: +146/-1
  • Offline Offline
  • Posts: 479
Re: ESProfle Image Management?
« Reply #17 on: April 16, 2025, 01:59:02 pm »

ESProFile "one of the best" What?  Says who?  It's works and it's CHEAP.  Does cheap automatically make is the best?  I don't agree.

Oh dear, I don't intend to start a debate on two fronts!

Saying "one of" the best is a great hedge, first of all --- I didn't say "THE best". But it all depends on what a buyer is optimising for. If you're on a budget and you like a menu for choosing a disk image, then I do think ESProFile is a great choice, and I'm really glad it exists. Meanwhile, if you're looking for something that has years and years of track record and good support, then X/ProFile is a top pick. If you like an electronics project that's also been around for a while, IDEFile is a lot of fun.

I'll tell you what isn't one of the best options under just about any circumstance: my own gizmo, since they don't make the SBC I use any longer. Too bad! Plus the selection of the bidirectional level adapter ICs I used in my design was poor and led to reliability problems on the internal connector of 2/10s. It was well-documented, at least! Another not-best option is a semi-abandoned Raspberry Pi gumstick project you can find on GitHub, and same for a thing I once saw on an Italian website that purports to use a PC parallel port to emulate a ProFile (which sounds interesting but awkward these days). I would love to link to these last two projects but Google these days is not helping me track them down like it used to.

Still, that's three choices that don't count as "one of the best", which you can revise to "top 50%" of six options I mentioned if preferable. Says who? Says me  :) I'm glad there are several fine emulators to choose from.
« Last Edit: April 16, 2025, 02:19:09 pm by stepleton »
Logged

AlexTheCat123

  • Sr. Member
  • ****
  • Karma: +81/-1
  • Offline Offline
  • Posts: 300
Re: ESProfle Image Management?
« Reply #18 on: April 16, 2025, 02:50:55 pm »

I have to say that I'm unmoved. Filesystem discoveries are of such basic utility to Lisa enthusiasts that big-presentation glory for one particular project (however famous) doesn't really justify keeping the secret in my book, at least not for a patch that I expect amounts to changing a single-digit number of bytes. (It will be interesting to know if that hypothesis is correct!) Other people may have other projects they want to accomplish on their machines, and in my own opinion it's better for everyone if they don't have to wait for such a fundamental enhancement.

I assume that patching the ProFile driver is a relatively small part of your efforts. If that's correct, and if wanting to "be there first" is part of your motivation, I wouldn't overestimate the number of people with the will and the patience to try and accomplish the "hard part", which is to build the Office System and its tools. Who knows, but I would expect that a lot of people have other designs on their free time between now and June.

But let's say that you did get scooped because someone else gets their hands on a big ProFile: the worst-case scenario! Maybe they will get some story-of-the-day fame on hackaday and hacker news or something. You're still the one who's going to show all your work to an excited crowd at VCF; you'll be filmed and people are going to be able to ask you questions and talk to you in person. You know the deep lore and the technical details, and your care to share your knowledge (eventually  :) ) suggests to me that your work will wind up as the primary reference for how to do it.

You were not the first person to make a ProFile emulator, but ESProFile is now celebrated as one of the best and most accessible options out there, and rightly so. I expect the same outcome for your current project even if you aren't the first across the line. (Although I suspect you will be regardless.)

Big ProFile Technique is your discovery and so the knowledge is yours to do with as you wish, for now. But I may get a wild hair someday and try to figure it out for myself, and if I do, I will remain tempted to tell everyone how to do it. I'm still pretty busy, though. Maybe it's this evening that I'll finally get time to test those Monitor ProFile images...


I see your point, and I think you've convinced me!


To be clear, I wasn't trying to keep it a secret to be "first" or anything. Besides, if anyone had wanted to compile bits of LOS before this, they could've split it up across multiple disks and done it piece by piece without any sort of patch whatsoever. Heck, that's what I was doing originally myself!


Of course, I would be delusional to claim that it wouldn't be a bit disappointing for someone else to come out of nowhere and finish first after all of this work, but that isn't the primary motivation for me, and it's really just more about the excitement factor of revealing it all at once. But if it's this important to people to have the patch, then it seems like it's probably the right thing to do.


My friend @warmech is going to come on here and be the one to actually share the details because he's the one who actually found the bytes that need to be changed in the disk image itself, and so he should get most of the credit here. It's only two bytes, and after I found the bytes that needed to be changed in the Pascal source, I originally didn't even bother searching through the disk image because I figured that those bytes would show up so many times that it would be impossible to find the right occurrance. But luckily he tried it anyway and now we have this patch! A big thanks to Will; he's been very supportive ever since I started of this project, and it's always nice to share the latest successes with him and bounce ideas off him!



ESProFile "one of the best" What?  Says who?  It's works and it's CHEAP.  Does cheap automatically make is the best?  I don't agree. 


This is something that is totally a matter of opinion. Some people are going to think that ESProFile is the best (or one of the best) emulators out there. Others are going to thing that X/ProFile or Cameo/Aphid or IDEFile is the best emulator. So I don't really think that this is something to argue about, given that it's very opinion-based. Different emulators have have their own unique pros and cons that are each going to matter more or less to different people.


I'll tell you what isn't one of the best options under just about any circumstance: my own gizmo, since they don't make the SBC I use any longer. Too bad! Plus the selection of the bidirectional level adapter ICs I used in my design was poor and led to reliability problems on the internal connector of 2/10s. It was well-documented, at least! Another not-best option is a semi-abandoned Raspberry Pi gumstick project you can find on GitHub, and same for a thing I once saw on an Italian website that purports to use a PC parallel port to emulate a ProFile (which sounds interesting but awkward these days). I would love to link to these last two projects but Google these days is not helping me track them down like it used to.


Another one to add to this list (in my opinion) is my old ArduinoFile emulator. It's really flaky with the 2/10 and parallel cards, and you might as well give up if you have an XLerator. Plus, the board design is ugly and a bit weird to assemble, and its diagnostic mode leaves a lot to be desired. Nobody should be building these anymore now that ESProFile is a thing!


I personally agree with Tom about the pros and cons of each emulator. ESProFile and Cameo/Aphid (with the PocketBeagle caveat for Cameo/Aphid) are great for people who want a really inexpensive emulator that allows you to select which disk image you want your Lisa to boot from at power-on. IDEFile is good for anyone who wants a fun "hardcore DIY" solution that uses parts that feel more period-accurate to the Lisa. And X/ProFile is good for anyone who wants something that's guaranteed to "just work" with customer support if anything goes wrong.
Logged

warmech

  • Full Member
  • ***
  • Karma: +19/-1
  • Offline Offline
  • Posts: 33
Re: ESProfle Image Management?
« Reply #19 on: April 16, 2025, 04:03:29 pm »

Howdy all.

When Alex and I were trying to figure out large(er)-scale storage options to get the LOS source on to a Lisa proper, he'd mentioned that you could flub with the block count on a ProFile image to get it higher than 10MB. I don't even remember what prompted me to go fishing through the LOS source for the ProFile drivers, but I cracked them open and it hit me like a ton of bricks. From "LISA_OS\OS\source-PROFILE.TEXT.unix.txt":

Code: [Select]
38  : (*Drive types*)
39  : T_Profile = 0;
40  : T_Seagate = 1;
41  : T_Widget  = 2;

... [For context, T_Profile is a 5MB model and T_Seagate is the 10MB model] ...

283: if (discsize <= 9728) or (discsize > 30000)
284:   then drivetype:= T_Profile (* set drivetype to profile *)

Anything that returns a max block count of less than 9729 or more than 30000 the Lisa treats as a 5MB Profile. There's some Widget vs Seagate logic a few more lines down but, ultimately, if it's not a T_Profile then it's a T_Seagate - fair enough. Since 30000 is an integer and this is Pascal, I reasoned that there had to just be a word in the compiled Profile driver somewhere that contained 30000. Sure enough, in LOS 3.0's first installer disk at address 0x1C7A6: $7530. Surely it couldn't be that easy... could it?

Since I don't actually have a working Lisa at my disposal at the moment, I rang up Alex and had him try a patched version (we ended up trying $FFFF ultimately) on a disk image on his ESProFile. Without any fanfare and after a loooooooooooooong wait, we were staring straight down the barrel of a 32MB ProFile in LOS. After the fact, Alex also found that this works for the first Workshop installer disk: 0x81A6 is where you want to patch.

[EDIT - There are notes in the ProFile ASM driver (I believe it was the ASM file...) that indicate that this could be expanded even further with some slightly more extensive tweaks to the driver. I haven't had any time to pry further, but the possibility allegedly exists.]

It's a relatively tiny contribution to an otherwise much, much larger project but the implications are - quite literally - huge. I'm happy to have figured it out, but it helps that it was just that simple, lol. ;D On the much more important flipside, Alex has been grinding away at all of this for some time now and I think the outcome will be a huge boon to the Lisa community. He deserves a ton of kudos for the progress he's made with the LOS source and I can't wait for y'all to see the outcome.

On another note, I second the idea that each of these emulators has their strong suits and each one occupies a slice of "best-hood". The X/ProFile does exactly what it needs to and has a rock-solid reputation; it might not be the cheapest option, but it's a damned fine product that meets about every expectation you could lob at it without fail. The ESProFile, on the other hand, is a happy blend of accessible, inexpensive, and functional; it's cheap (but not "cheap"), it's an open design, and - as Tom pointed out - it runs Selector, which is just too damned convenient not to use.
« Last Edit: April 16, 2025, 04:06:59 pm by warmech »
Logged

stepleton

  • Sr. Member
  • ****
  • Karma: +146/-1
  • Offline Offline
  • Posts: 479
Re: ESProfle Image Management?
« Reply #20 on: April 16, 2025, 04:51:01 pm »

Thanks all for humouring my morning crankiness... this may be a simple change, but it's a really exciting new capability for the community! And it may mark a new phase in the life of Lisa OS --- how long has it been since there was a patch of any kind that added novel functionality to system? This is the first one I can remember: to me at least, LOS and the Workshop have basically been fixed in amber for as long as I've been familiar with Lisa.

I have to admit that Alex's choice of 30,000 felt like too much of a coincidence with that line in `source-PROFILE.TEXT.unix.txt`, which I had cracked open after his first message. I was minded to scan floppy images for someplace where the words $2700 (9728) and $7530 were near neighbours next --- in one of those somedays I keep waiting to come around.

And that's another exciting thing: this may be the first time that having the source code to hand has enabled a functional change to the OS, which in a way validates all the effort that Al Kossow put in to making the it available. It sounds like it's just the first of what could be many thanks to the work that's underway now.

Good luck, Alex! I can't wait to see what you've got to show us in just a few weeks!
Logged

bmwcyclist

  • Sr. Member
  • ****
  • Karma: +15/-0
  • Offline Offline
  • Posts: 108
Re: ESProfle Image Management?
« Reply #21 on: April 20, 2025, 12:42:10 pm »

Just to be clear...

Am I correct that there is no Macintosh or window software available to Mount an ESProfile image for easy maintenance and manipulation?
Logged
Using my LISA for writing blogs and other work projects and fun and games at home. LISA 2/10, AST RAM board, ESProfile, FloppyEMU, Mac2LISA Mac extended keyboard, reproduction LISA 1 mouse.

stepleton

  • Sr. Member
  • ****
  • Karma: +146/-1
  • Offline Offline
  • Posts: 479
Re: ESProfle Image Management?
« Reply #22 on: April 20, 2025, 05:50:11 pm »

Not really, so far as I'm aware, but I don't have a lot of experience with MacWorks images, so things may be a bit easier there.

An ESProFile image is a "raw" sector-by-sector representation of what's on an Apple parallel port hard disk like a ProFile or a Widget. We have these kinds of raw images for other, modern applications --- they're often called .iso files, a term that originally referred to CD and DVD images but that I think has become more generic. Sometimes you can mount .iso files on modern OSs, but they tend to be ones that store images of drives that were created by more modern operating systems.

The challenges of treating an ESProFile like a modern disk image are these ones that I can think of:

- ProFiles and Widgets use odd sector sizes: 532 bytes, which is not a power of 2. This is unusual for modern hard disks, and I would expect that most modern software that deals with disk images may have difficulty dealing with this.

- The filesystems used by various versions of the Lisa OS were not used anywhere else, and no software or operating system that mounts disk images (yet) recognises it. It would be a fun project to use FUSE to give this capability to modern Unix OSs, as some have done for reading earlier MacOS media on modern MacOS. Apple even once shipped an example of using FUSE to read old MFS volumes, but don't do this any longer. Anyway, nothing like this exists for LisaOS volumes right now.

- Let's say you want to read a MacWorks disk image. Again I'm not so familiar with MacWorks, but some (all?) MacWorks installations incorporate the Lisa Monitor OS's filesystem, so they are probably not easily readable as ordinary Macintosh volumes.

So the short answer is "not really", I think. For Lisa OS, the closest thing I can think of is Aaru made by long-ago LisaList person claunia (not seen for a while!) which at least supports read-only access to the files on some hard drive image formats. I am not sure whether raw sector-by-sector dumps are among them given ProFile/Widget's weird sector size.
Logged

sigma7

  • Administrator
  • Hero Member
  • *****
  • Karma: +169/-1
  • Offline Offline
  • Posts: 560
  • Warning: Memory errors found. Verify comments.
Re: ESProfle Image Management?
« Reply #23 on: April 20, 2025, 06:31:52 pm »

Quote
[ mis quote]
is there any software available to Mount [a hard disk used by a Lisa]
[ / mis quote]

When a SCSI drive is used by MW+/II, it remains in the same format as a MacPlus would use it, so could be moved to an older Mac with SCSI and mounted (assuming compatible drivers and so on).

As such, I think that the hard disk image on eg. BlueSCSI media might be mountable using some kind of software.

... but that's limited to images of SCSI drives, and not applicable to parallel port drive images.
Logged
Warning: Memory errors found. ECC non-functional. Verify comments if accuracy is important to you.

AlexTheCat123

  • Sr. Member
  • ****
  • Karma: +81/-1
  • Offline Offline
  • Posts: 300
Re: ESProfle Image Management?
« Reply #24 on: April 20, 2025, 09:04:15 pm »

Am I correct that there is no Macintosh or window software available to Mount an ESProfile image for easy maintenance and manipulation?


Yeah, Tom is right in terms of directly mounting and manipulating the image. The only thing you can really do to mess with an image from a modern computer is to convert it to a dc42 image using the tools included with LisaEm, and then boot LisaEm from your new dc42 file to mess with it however you need to. Then convert it back to a raw image to put back onto your ESProFile's SD card. But depending on what you're trying to do, this might be more trouble than it's worth!
Logged
Pages: 1 [2]   Go Up