Page 1 of 7 1 2 3 4 5 6 7 LastLast
Results 1 to 20 of 131

Thread: Sample PshopTest Results

  1. #1
    Join Date
    Aug 2000
    Location
    Concord, CA
    Posts
    7,056

    Default Sample PshopTest Results

    Last two tests run according to 1.0b4 docs. All tests calculated according to 1.0b4 PshopTestScore doc. I may have to edit this if I find any errors. It looks daunting but after a couple of tests, I got the hang of it and is straightforward. I have some more advanced tests that Boots wants me to run.

    Ran Pshop 7.0.1 for TEST1 and TEST2, and Pshop CS demo 8.0 (8.0x119) for TEST4, TEST5, and TEST6. Installing the demo is not recommended unless you plan to purchase CS or the CS upgrade from 7.0.

    Note: the only differences between these tests:
    1. In Step 10, Relative Colorimetric (default 7.0.1), Perceptual (default CS 8.0).
    2. TEST1, TEST2, and TEST4 with single DiamondMax10-16MB 300GB PATA drive with Apple driver, capacity 279.35GB, available 279.29GB (empty).
    3. TEST5 with 2x DiamondMax10-16MB 300GB PATA drives with Apple RAID, single volume, available 558GB (empty).
    4. TEST6 with 2x DiamondMax10-16MB 300GB PATA drives with SoftRAID 3.1.1 RAID, two volumes, first volume capacity 100GB, available 99.96GB, with 64KB stripe unit size (empty). Second volume about 458GB and not used for the Pshop tests.
    5. All tests, DMax drives on Acard 6885M, separate channels for each drive where RAID used.

    All tests GigaMDD

    TEST1(7.0.1)**TEST2(7.0.1)**TEST4(CS 8.0 demo)**TEST5(CS 8.0 demo)**TEST6(CS 8.0 demo)
    Activity Monitor Update Frequency all tests 2s
    Cache levels all tests 4
    Available RAM TEST1-1879MB (7.0.1), TEST2-1881MB (7.0.1), TEST4 thru 6-1879MB (CS)
    Max used by Pshop TEST1-50%=939MB, TEST2-70%=1317MB, TEST4 thru 6-70%=1315MB (CS)
    Test file size 512MB - 2183.5 (for all tests)

    1. Open=14.3s**14.5s**8.4s**8.5s**8.5s
    2. Rotate Canvas 180=46.9s**14.2s**4.6s**4.6s**4.6s
    3. Apply Image=14.0s/29.2s**7.3s/8.4s**6.8s/7.7s**5.5s/6.5s**5.4s/6.3s
    4. Save=4.7s**5.0s**4.6s**4.4s**4.2s
    5. Canvas Size=10.3s**2.6s**2.1s**2.1s**2.1s
    6. Auto Color=3.0s/5.7s**1.8s/2.7s**1.9s/2.7s**2.0s/2.8s**1.9s/2.8s
    7. Gaussian Blur=9.3s/17.2s**6.2s/7.1s**6.8s/7.6s**6.8s/7.6s**6.8s/7.6s
    8. Sharpen=10.5s/26.7s**3.3s/4.2s**3.1s/3.9s**3.1s/3.9s**3.1s/3.9s
    9. Save=5.8s**5.8s**5.3s**5.1s**4.4s
    10.Convert to Profile=20.0s/53.1s**15.8s/16.0s**15.1s/15.1s**15.1s/15.2s**15.1s/15.1s
    11.Save=11.4s**11.6s**10.7s**9.9s**9.2s
    12.Convert to RGB=27.1s/36.0s**21.6s/21.6s**20.7s/20.7s**20.9s/20.9s**20.9s/20.9s
    13.Save=9.3s**9.3s**9.0s**8.5s**7.7s

    LineA. Operations Total
    Pre-draw=TEST1-83.9s**TEST2-56.0s**TEST4-54.4s**TEST5-53.4s**TEST6-53.2s

    Re-draw Total (not average)=TEST1-84.0s**TEST2-4.0s**TEST4-3.3s**TEST5-3.5s**TEST6-3.4s

    Operations Total=TEST1-225.1s**TEST2-76.8s**TEST4-64.4s**TEST5-63.6s**TEST6-63.3s

    LineB. Save Total=TEST1-31.2s**TEST2-31.7s**TEST4-29.6s**TEST5-27.9s**TEST6-25.5s

    LineC. Open and Save Total=TEST1-45.5s**TEST2-46.2s**TEST4-38.0s**TEST5-36.4s**TEST6-34.0s

    LineD. Test Total=TEST1-270.6s**TEST2-123.0s**TEST4-102.4s**TEST5-100.0s**TEST6-97.3s

    GigaMDD 1.42GHz DP dual boot, 10.3.7, GF4ti, 2.0GB RAM. Pshop 7.0.1 (TEST1, TEST2), Pshop CS 8.0 demo (TEST4, TEST5, TEST6).

    TEST1-Pshop 7.0.1 50% memory assigned. Boot and Pshop drive on 120GB 180GXP-8MB (dual boot volume) ATA/100 bus, capacity 115.02GB, available 70.37GB. File and scratch volume: DiamondMax10-16MB 300GB PATA drive on Acard 6885M (only drive on the 4-channel card), capacity 279.35GB, available 279.29GB (empty).

    TEST2-Same as above except 70% memory assigned.

    TEST4 thru TEST6, Pshop 8.0 CS demo. Boot and Pshop drive on 120GB 180GXP-8MB (dual boot volume) ATA/100 bus, capacity 115.02GB, available 70.04GB (installation of CS). File and scratch volume: explained at the top of this post.

    Observations:
    LineD is the bottom line total for results. The biggest difference for me was upping the Pshop RAM from 50% to 70%. CS also yields a large difference. Further honing at 70% RAM in CS, as you can see, not a lot of difference for these tests in striping the 2 drives with Apple RAID, just too large a volume and unable to partition. SoftRAID does allow partitioning and showed a better total decrease and could be important if larger file sizes are used. One single fast file and scratch drive and CS however are sufficient for my use of Pshop. k
    Last edited by kaye; 01-14-2005 at 06:20 PM. Reason: Clarified post title.

  2. #2
    Join Date
    Jun 2004
    Location
    nyc
    Posts
    40

    Default

    First off, Boots thanks for all the effort in creating a very thorough and useful test. I ran it twice to compare using a FW drive to hold a work file vs using an internal Raptor 36GB to hold a work file.
    Some specs: G5 2.5, OS 1.3.7, stock video card, 3GB RAM (memory allocation 100%), scratch is RAID 0x4 (Raptor36GB on Sonnet 4x4PCI card). DW showed all drives at 1% files out of order or less before running the test.
    Results of 512MB test file:
    Operations total(FW) 32.9
    Operations total(Raptor) 33
    Open+Save total(FW) 67.4
    Open+Save total(Raptor) 32.8
    TOTAL SCORE(FW) 100.3
    TOTAL SCORE(Raptor) 65.8

    Predraw scores were identical in both setups so the score difference reflects the slower open and saves on the FW drive. Compared with Kaye's results the G5 was at least twice as fast on all steps except for opens and saves, where the Raptor was within a second or less either way and the FW drive was considerably slower. I'm pleased with the results and later will try a memory allocation of 70% and see if that alters anything.

  3. #3
    Join Date
    Aug 2002
    Posts
    1,010

    Default

    Nice A.D.
    Thank you for using the test.

    If you can, do try the 192MB test file size at 70% and 100%.

    My tests on G5 show at smaller file sizes, 100% allocation slows things down.
    It seems to be that above certain file sizes 100% is faster-
    But don't assume with CS that 100% allocation is fastest all across the board.

    I'm planning more tests on this to get to the bottom of this particularity- I'm not yet sure of what's up with that..

  4. #4
    Join Date
    Jan 2005
    Posts
    63

    Default

    Rumors are rumors....but I heard that Adobe is likely to release CS2 in the next few months. I'm waiting for the move from 7.0

    D

  5. #5
    Join Date
    Jun 2004
    Location
    nyc
    Posts
    40

    Default

    Boots,
    I ran Pshop test with the 192MB file at both 70% (1.261MB) and 100% (1.803MB) RAM. Any speed differences favored the 70% allocation but the overall test scores were only 1 second apart. Auto color, Blur, and Convert were anywhere from .1s to .4s faster at 70%. It is interesting that allocating less memory would be measurably faster and if you get an answer out of Adobe I'd love to hear it. But given that both tests came in just over 2x as fast as the 512MB test, I'm content to stick with 100% and actually get some work done
    192MB results:
    Operations total (70%)=14
    Operations total (100%)=14.9
    TOTAL SCORE (70%)=28
    TOTAL SCORE (100%)=29

  6. #6
    Join Date
    Aug 2002
    Posts
    1,010

    Default

    A.D. Thanks for running those tests...Confirms my results.

    You might also want to check out this thread also for an interesting FYI:
    http://www.macgurus.com/forums/showt...9625#post79625

  7. #7
    Join Date
    Aug 2000
    Location
    Concord, CA
    Posts
    7,056

    Default

    Boots sez:
    If you're game for more testing Kaye, I'd recommend the following with Photoshop CS only:

    I assume you have processor setting in energy saver at 'highest'-

    1. Using the 192MB test file size, and your fastest hardware setup-
    a. test with a 70% memory allocation (Advanced TEST1a = AT1a)
    b. then again with a 100% memory allocation (Advanced TEST1b = AT1b)

    Ran Pshop CS demo 8.0 (8.0x119) for AT1a and AT1b.

    1. Both tests with 2x DiamondMax10-16MB 300GB PATA drives with SoftRAID 3.1.2 RAID, two volumes, first volume capacity 100GB, available 99.96GB, with 64KB stripe unit size (empty). Second volume about 458GB and not used for the Pshop tests.
    2. Both tests, DMax drives on Acard 6885M, separate channels for each drive.

    Both tests GigaMDD

    AT1a(CS 8.0 demo)**AT1b(CS 8.0 demo)
    Activity Monitor Update Frequency 2s
    Cache levels 4
    Available RAM AT1a-1878MB, AT1b-1879MB
    Max used by Pshop AT1a-70%=1314MB, AT1b-100%=1879MB
    Test file size 192MB

    1. Open=4.3s**4.3s
    2. Rotate Canvas 180=1.8s**1.7s
    3. Apply Image=2.4s/2.4s**1.8s/2.4s
    4. Save=2.5s**2.5s
    5. Canvas Size=1.6s**1.6s
    6. Auto Color=0.9s/1.3s**1.2s/1.8s
    7. Gaussian Blur=2.5s/2.9s**3.4s/5.0s
    8. Sharpen=1.3s/1.6s**4.2s/6.1s
    9. Save=1.9s**2.8s
    10.Convert to Profile=6.9s/6.9s**18.0s/18.0s
    11.Save=3.0s**4.9s
    12.Convert to RGB=8.4s/8.4s**14.0s/14.0s
    13.Save=2.5s**3.7s

    LineA. Operations Total
    Pre-draw=AT1a-22.4s**AT1b-43.0s

    Re-draw total (not average)=AT1a-1.1s**AT1b-4.7s

    LineA. Operations Total=AT1a-26.9s**AT1b-51.0s

    LineB. Save Total=AT1a-9.9s**AT1b-13.9s

    LineC. Open and Save Total=AT1a-14.2s**AT1b-18.2s

    LineD. Test Total=AT1a-41.1s**AT1b-69.2s

    GigaMDD 1.42GHz DP dual boot, 10.3.7, GF4ti, 2.0GB RAM, Pshop CS 8.0 demo.

    Tests AT1a andAT1b, Pshop 8.0 CS demo. Boot and Pshop drive on 120GB 180GXP-8MB (dual boot volume) ATA/100 bus, capacity 115.02GB, available 70.04GB. File and scratch volume: explained above.

    Observations:
    Limitation of 2GB of real RAM in GigaMDD at 100% memory assignment in Pshop CS really hurts. Up thru Test 5 the results are about the same. Beginning with Test 6 (Auto Color) the results start going downhill and rapidly get worse thru the last step, Step 13. I think I will leave Advanced Tests 2 to those with more real RAM. At least you get the idea of what a G4 can and cannot do. k

  8. #8
    Join Date
    Aug 2002
    Posts
    1,010

    Default

    This is awesome Kaye, thank you.

    These results are starting to give us a real good idea about what to do for allocation in PS memory prefs with particular RAM conditions.

  9. #9
    Join Date
    Jun 2004
    Location
    nyc
    Posts
    40

    Default

    Re: Kaye's test numbers I can understand the significant dropoff with only 2GB RAM installed.The OS (and whatever else) are being starved for memory, far offsetting any gain in devoting more RAM to PS. With 3GB of memory on my G5, the dropoff was only 1 second in total, presumably because of the extra memory available to the rest of the system. So it would appear that the 70% rule is must for 2GB setups but virtually a non-issue when 3GB+ are installed.

  10. #10
    Join Date
    Aug 2002
    Posts
    1,010

    Default

    Yes, and it's this memory starvation- when does it begin, what's the relationship to rprvt in top or Activity Monitor....Because I think we are led to think X needs only 250-300MB to run and yes it does if you want to be frugal, but it is significant how much more she really wants to really run good. I want to see if the 70%/100%-bigfile/littlefile anomoly is eliminated with more than 4GB RAM in machine-

    But I don't think it will be. I think Photoshop is so strong in it's memory management, how much it can control the OS, kinda brilliant cause it seems like it has a wide tolerance.

    I have a feeling- and I say this with all due respect; that perhaps Adobe has not really tested this to the point where they can say 'this is the exact what's up with memory & Photoshop'. If you read what they say in this and this, it seems vague and a bit contradictory, and out of date...
    I venture to say, we are working it out for them a bit on the Mac. I'd love to re-write portions of those docs for them!
    Last edited by Boots; 01-19-2005 at 05:55 AM.

  11. #11
    Join Date
    Sep 2004
    Location
    Loma Mar. CA
    Posts
    328

    Question Boots.

    Quote Originally Posted by Boots
    Yes, and it's this memory starvation- when does it begin, what's the relationship to rprvt in top or Activity Monitor....Because I think we are led to think X needs only 250-300MB to run and yes it does if you want to be frugal, but it is significant how much more she really wants to really run good. I want to see if the 70%/100%-bigfile/littlefile anomoly is eliminated with more than 4GB RAM in machine-

    But I don't think it will be. I think Photoshop is so strong in it's memory management, how much it can control the OS, kinda brilliant cause it seems like it has a wide tolerance.
    Just a quick question. I know what Activity Monitor is, but what does 'rprvt in top' refer too? Sorry if this is really dumb!

    CB
    Last edited by Chris Billington; 01-19-2005 at 09:30 AM.
    It's a nice nose! I like it! It's chewy!!

  12. #12
    Join Date
    Aug 2002
    Posts
    1,010

    Default

    Chris, it's the amount of actual RAM an app is using just for itself and not any shared components (Resident private address space size), under the column "RPRVT" in 'top' output in a Terminal window: open Terminal, type 'top' without the quotes and hit enter, then the memory stats for all running apps are displayed.
    Part of how much memory is being used at any one time..

  13. #13
    Join Date
    Sep 2004
    Location
    Loma Mar. CA
    Posts
    328

    Cool Always interesting.

    Always usefull!!

    CB
    It's a nice nose! I like it! It's chewy!!

  14. #14
    Join Date
    Aug 2000
    Location
    Concord, CA
    Posts
    7,056

    Default

    Tested my QS/PF with 1.5GB RAM in Pshop 7.0.1. Not to compare with the GigaMDD but to test various Memory Allocations. This computer has everything but the kitchen sink and no CS demo. PCI slots full. No empty scratch disks. All tests the same except for memory assigned to Pshop.

    Test file 512MB - 2183.5

    50% test, 1394MB, 697MB assigned
    60% test, 1393MB, 837MB assigned
    65% test, 1395MB, 907MB assigned
    70% test, 1394MB, 975MB assigned

    Memory Assigned 50%test**60%test**65%test**70%test
    LineD Test Total**609.4s**476.3s**358.6s**256.4s

    70% allocation works very well with max RAM of 1.5GB. k

  15. #15
    Join Date
    Nov 2004
    Location
    Germany
    Posts
    2,352

    Default

    Hello Kaye,

    great info!

    Regards

    Nicolas

  16. #16
    Join Date
    Aug 2000
    Location
    Concord, CA
    Posts
    7,056

    Default

    Yesterday, I ran the Pshop Test version 1.0 on my GigaMDD, 2GB RAM, this time with a UL3D-033 and Burly with 4x 18GB X15.3 split into 2 channels, SoftRAID 3.1.3 striped.

    Three test results, tho I actually did more, 10.3.9 and CS, 10.3.9 and CS2, 10.4 and CS2. More on those tests later when I figure out how to put it together in detail. NOTE: the Pshop Test docs clearly state that System Requirements are Mac OS 10.3.x. Not yet designed or modified for 10.4.

    Installation of CS2, there was good and bad. First, it seems that CS2 does not like installation 2 times even on the same computer but different drives. I installed CS2 on my main 10.3.9 boot drive and on my test 10.4 boot drive while booted from the 10.3.9 drive. When booted in 10.4, CS2 would not launch, gave me two warning messages about some items missing and quit. So I had to redo the installation in 10.4. And the security now of preventing multiple installations is a pain. I will have to do a Transfer Activation of CS2 with Adobe to put it on a G5, rendering CS2 on my GigaMDD inoperative. Then I gotta figure out how to uninstall CS2 on the MDD. The good news is that in 10.3.9 it did not wipe my previous CS installation.

    Couple of notes about CS2. Step 10 Convert to Profile is no longer Image menu>Mode>Convert to Profile. It is now Edit>Convert to Profile. Also in CS2, the same Step 10, the default is Relative Colorimetric (like Pshop 7) but I changed it to Perceptual to match CS results.

    Last, in CS2, default cache levels is 6 whereas it was 4 in CS. So I did a couple of full tests in CS2 with 6 and 4 just to compare and there was no difference. So I left it at 6 for subsequent tests. Ultimately I will have CS on the GigaMDD and CS2 on a G5. More later. k

  17. #17
    Join Date
    Aug 2000
    Location
    Concord, CA
    Posts
    7,056

    Default

    Ran Pshop CS for TEST1 in 10.3.9, CS2 for TEST2 in 10.3.9, and CS2 for TEST3 in 10.4.

    Note: the only other differences between these tests:
    1. In Step 10, Perceptual (default CS), Relative Colorimetric (default CS2) changed to Perceptual.
    2. Cache levels 4 (default CS), 6 (default CS2).

    All tests GigaMDD, 2GB RAM, GF4ti, UL3D-033, Burly 4x 18GB X15.3 split into 2 channels, SoftRAID 3.1.3 striped, 64KB stripe units, Workstation.

    TEST1(CS-10.3.9)**TEST2(CS2-10.3.9)**TEST3(CS2-10.4)
    Activity Monitor Update Frequency all tests 2s
    Cache levels 4 (CS), 6 (CS2)
    Available RAM TEST1=1860MB (CS), TEST2=1963MB (CS2), TEST3=1963MB (CS2)
    Max used by Pshop TEST1-70%=1306MB (CS), TEST2-70%=1374MB (CS2), TEST3-70%=1374MB (CS2)
    Test file size 512MB - 2183.5 (all tests)

    1. Open=8.8s**10.8s**11.1s
    2. Rotate Canvas 180=4.0s**10.0s**10.4s
    3. Apply Image=4.5s/5.5s**5.9s/8.1s**5.9s/7.1s
    4. Save=4.3s**4.5s**4.4s
    5. Canvas Size=2.1s**2.6s**2.5s
    6. Auto Color=1.9s/2.8s**1.8s/2.8s**1.8s/2.8s
    7. Gaussian Blur=7.0s/7.8s**6.5s/7.6s**6.3s/7.3s
    8. Sharpen=3.1s/4.0s**3.0s/4.1s**3.1s/4.1s (See NOTE below)
    9. Save=4.3s**4.4s**na
    10.Convert to Profile=15.1s/15.2s**14.9s/16.3s**na
    11.Save=8.2s**8.1s**na
    12.Convert to RGB=20.8s/20.8s**20.7s/20.7s**na
    13.Save=6.9s**6.3s**na

    LineA. Operations Total
    Pre-draw=TEST1-52.4s**TEST2-52.8s

    Operations Total=TEST1-62.2s**TEST2-72.2s

    LineB. Save Total=TEST1-23.7s**TEST2-23.3s

    LineC. Open and Save Total=TEST1-32.5s**TEST2-34.1s

    LineD. Test Total=TEST1-94.7s**TEST2-106.3s

    Pshop CS2 certainly seems optimized for a G5 with lots more RAM capability.

    NOTE: Sharpen in 10.4 hung at the completion of this test showing 99+% CPU usage in Activity Monitor tho no drive activity and confirmed no activity by Burly LEDs and Granite external LED indicator. Unable to complete a successful Forced Quit and had to hard shutdown. Not brave enough to try that again. k
    Last edited by kaye; 05-07-2005 at 05:50 PM.

  18. #18
    Join Date
    Aug 2002
    Posts
    1,010

    Default

    Interesting numbers Kaye. Thank you for testing and posting the results.

    The new activation requirement certainly inspires careful planning, but at least Adobe still allows installation on two computers..

    Is the open & save location for the test file on the striped volume or the startup disk?
    The designated scratch disk I take it is the 4x15.3k?

    Thank you for the observations on the change to "Edit>Convert to Profile". I undertsand also from other informants the Print with Preview dialog has changed- as well as the default memory allocation to 70% (up from 50%).

    NOTE: the Pshop Test docs clearly state that System Requirements are Mac OS 10.3.x. Not yet designed or modified for 10.4.
    I plan to purchase CS2 in the near future, and then I will update PshopTest accordingly once I've investigated.

    -----

    My guess is you might be better served dialing back the memory allocation a bit in CS2 for the MDD, since it shows slower results at 70% than CS1.

    The results for Step #2 Rotate Canvas really stick out as a possible difference in the way CS2 implements that operation...or- could be system memory starvation. Another CS2 PshopTest tester on a G5 Dual 2GHz with 4GB installed RAM got results very similar to CS1 for that step- around 3.5 sec.

  19. #19
    Join Date
    Aug 2000
    Location
    Concord, CA
    Posts
    7,056

    Default

    Is the open & save location for the test file on the striped volume or the startup disk? The designated scratch disk I take it is the 4x15.3k?
    Open & save location for the test file is on the striped volume, 4x15.3k, which is the designated scratch disk. I didn't even look for the Print with Preview dialog but my recollection of the default memory allocation is 70%, tho I'm not positive.

    My guess is you might be better served dialing back the memory allocation a bit in CS2 for the MDD, since it shows slower results at 70% than CS1.

    The results for Step #2 Rotate Canvas really stick out as a possible difference in the way CS2 implements that operation...or- could be system memory starvation. Another CS2 PshopTest tester on a G5 Dual 2GHz with 4GB installed RAM got results very similar to CS1 for that step- around 3.5 sec.
    It looked to me that dialing back the memory allocation a bit would work better for my MDD and you confirm that. I didn't test that because I decided that CS2 would go on a G5 and CS would be for the MDD. I could not come to any conclusion about my poor result for Step #2 in CS2 but you are undoubtedly right. Steps 10 thru 13, CS2 does better than CS for me. k

  20. #20
    Join Date
    Aug 2000
    Location
    Concord, CA
    Posts
    7,056

    Default

    Worked on finding the sweet spot with Pshop CS2 on my GigaMDD. All Memory assignments below 70% (65-69%) were slower. So I tried some above (71-73%). I won't bore you with all of the details but there is a sweet spot for this MDD with 2GB RAM, 10.3.9. Some representative results with best CS2 and CS boldfaced:

    LineD. Test Total=TEST1/CS2-66%-117.0s**TEST2/CS2-67%-112.8s**TEST3/CS2-68%-109.8s

    LineD. Test Total=TEST4/CS2-70%-106.3s**TEST5/CS2-71%-105.0s**TEST6/CS2-72%-102.3s**TEST7/CS2-73%-107.2s

    Still not faster than my CS score of 94.7s k

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •