Campuses:
Attendance: SH, Jamie, Jacques, Charles, Amy, Al
Notes by:
Signals and Noise Figure
Decadal Panel Papers
Review of TeamX Slides
Shaul's Comments
Kogut Comments (June 25)
Hi Shaul,
I went through the TeamX instrument and mission reports. I agreed with most of it, but found some problems and some areas that need clarification to avoid mis-interpretation. Starting with the big items, we have:
1) Discussion of I&T is inadequate for a cryogenic instrument. The instrument report estimates $6.1M for I&T at 50% confidence (slides 31 & 32) but gives no detail. Is this a wrap? Is the percentage for I&T in family with previous cryogenic missions? The mission report says $1.9M for observatory-level integration and test (slide 131) and shows only 20 days for observatory thermal vacuum testing. Both are gross under-estimates. 60 days for observatory thermal vacuum testing would be more appropriate. Adding some discussion of chamber mods for sub-K instrument would also be a good idea.
2) The estimated heat loads for the cryogenic stages seem low to me. The instrument report slide 81 says 3.8 mW CBE for the load at 4.5 K. Does this include the heat rejected from colder stages by the ADR? I note that PIXIE has much larger heat leak at 4.5K despite a much smaller cold volume. There's also a discrepancy between the heat loads reported in slides 79 and 81 of the instrument report: Slide 79 shows 14 uW load on the 100 mK stage while slide 81 says 4.8 uW. PIXIE carried 20 uW at 100 mK, again with a much smaller cold volume. Do we have any info on the estimates from LiteBIRD or CORE? It would help to show PICO estimates as in-family with other mission concepts.
3) The instrument report was not clear about how the cryocoolers reject heat. The compressors need to be mounted on the rotating stage, and take a fair amount of power (339W CBE), but I couldn't find any mention about radiators for the cooler. Is the cooler radiator in the outermost V-groove?
4) I don't see the value in including detector design option 2 (mixed TES / MKID focal plane) in the TeamX instrument report. MKIDs are considerably lower TRL and there's no real discussion of the (limited) benefits. If we can show we meet the science requirements within the cost cap using the baseline design, I would leave it at that and not open potential cans of worm for lower-TRL designs.
5) I don't see any clear description of the various observatory modes. In particular, what is safe mode? The instrument report slide 53 discusses using thrusters to slew during safe mode. Why do we want to slew during safe mode? Keeping the spin seems reasonable, but I don't see any justification for slewing…
6) The mission wraps for systems engineering (mission report slide 36, WBS 2) seem a little light, particularly for a cryogenic mission. It's cited at $17.0M, or 4% of the total hardware costs in WBS 5+6. 5% would be more appropriate. Granted, it's only a $2M difference, but why skimp here?
7) There needs to be a better discussion of the contingency for cryo-cooler power. A given cooler design (e.g. a MIRI cooler) has a fixed max power. You can't run one at 110%. The margin and contingency for the cooler are kept on the thermal side: typically want 100% at this early stage. Thus, the cooler will show 100% margin/contingency vs the expected thermal load, but a fixed max power with no added contingency beyond the contingency already built in to account for the thermal load. This typically need to be spelled out to the cost folks. The instrument report slide 83 spells out 100% margin in thermal load PLUS an additional 70% contingency in power. This is too conservative, so perhaps we can use this to cut costs (in the cost model, anyway).
8) PICO plans to field a large cryogenic focal plane with lots of detectors. Can we provide any comparisons with current state of the art? For example, the instrument report slide 67 says there will be 21 detector modules at 0.3 kg/module, for a total of 6.3 kg at 100 mK. What's the heaviest existing focal plane assembly? At what temperature? Similarly, Slide 62 says the detector yield will be above 90%. What is the demonstrated yield for existing focal plane arrays?
9) The Cost rationale for WBS 7 (Mission Ops) in the mission report slide 41 should cite the simplicity of PICO ops: Single instrument with a single science observing mode. Science mode is simple spin/precession with no targets of opportunity or guest investigator program. No part of the sky is more or less interesting than any other.
There are also some relatively minor points:
10) The instrument executive summary (slide 9) should include the CBE (or maybe MEV) thermal loads at the critical 4K and 100 mK stages. It's hard to think about the coolers without knowing the loads.
11) Change “Mirror” to “Reflector”, throughout.
12) The instrument report slide 35 says that the cost driver for the cooler is the minimum required temperature. Nothing is said about total heat lift at minimum temperature. Should we say that the PICO expected heat lift is in family for the various coolers cited?
13) What is meant by the “negligible (1 nW)” power per detector in the instrument report Slide 67? The detector readout is considerably bigger than that …
14) the discussion of cosmic ray hits (instrument report slide 72) is confusing for anyone not already an expert. Need to state that the vast majority of Planck CR hits were to the detector frame, not the detectors per se. The PICO design eliminates such frame hits by heat-sinking frame to bath, as validated by Suzaku, Keck and SPIDER.
15) Three reaction wheels is OK, but provides no margin against single wheel failure. Four wheels is better (robust against single failure). Mission report slide 58 says design is tolerant to single wheel failure. It's not immediately clear to me how this happens.
16) The mission report slide 144 says that the instrument continues to observe during Ka-band downlinks. Is there a risk for science data loss at Ka band or harmonics? Given the 4 hr/day download, this could be significant. Can we provide an estimate of the leakage from the Ka-band transmitter to the Ka-band detectors?
Not all of these need to be addressed via the cumbersome TeamX response/rebuttal process, but we should fix what we can now and keep the rest in mind for the eventual PICO report.
Cheers, Al
Jamie's Comments
Hi Shaul,
Reading through the report, here are some suggestions. I read the main report first, the instrument report second, as indicated by the dividers.
Major - Main
1. Analogies to justify the schedule on slide 34. Because Planck and Herschel were much longer, one may argue the schedule represents a major cost risk, and it seems very aggressive to me. I think the integration and testing of a large 100 mK instrument especially needs to be carefully justified and costed.
2. Along these lines, I did not see a development plan for instrument through to S/C level testing. Will it go through the usual practice of EM and qualification units like Planck and Herschel? That is arguably appropriate but adds time to the schedule. Not having a schedule or at least an integration plan is a problem and will cause reviewer confusion. For example, the V-groove test may be justified (slide 113), but how does this fit with the general demonstration of the cryo instrument? What are the steps?
3. There is little mentioned about spinning satellite platforms to justify the costing. I have no idea how comparable this is to SMAP, though this was not a cheap mission. Providing analogies to existing systems to justify the cost estimate would strengthen the case. Is the SMAP pointing performance suitable or are we in a different regime?
4. Where is the boundary with the payload? I see the v-grooves are part of the S/C thermal system. I would say the V-grooves are integral to the instrument performance and would put them in the payload WBS. Certainly the bottom panel is a much simpler interface than the cold side of the V-grooves. Likewise I am unclear about the cables, but would make the boundary after the instrument electronics. I would generally make the interface to the payload the bottom of the spin platform (except for the ACS components on the spinning deck). An easily defined and simple interface boundary will help.
5. For the SVIT, Planck ran a TVAC test with the spacecraft with the payload cooling to 100 mK. Is such a test planned? I can't imagine it fitting in 20 days (slide 139). I think one should look hard at this phase of the project for Planck to see if it is underscoped.
Major - Instrument
1. Need explicit cost analogies for major parts: detectors, readout electronics, telescope, v-grooves, I&T and science. Assume the cost modelers don't know what these units even are. Provide sufficient cost and schedule information from Planck and WMAP to justify these estimates. E.g. explain how you scale from single-detector fabrication and test activities with Planck to fabrication and test of arrays. Likewise need cost analogies for the 4 K cooler and ADR from other missions. Some of these items are reasonably well covered (telescope), some are open (e.g. science). Science certainly will cost more than the standard team-X wrap.
2. Can the instrument electronics, compressors and cooler electronics really reside in the non-spinning section? That requires a huge number of low-signal wires and pressure lines through a rotating connection. Scares me! I would put these units on the spinning platform and have rotating connections for data and power.
Minor - Main
1. It would be helpful to clearly call out the single operating mode. That's a plus obviously but you have to dig through the report to find it.
2. Team-X generally does a good job on the standard spacecraft systems and uses similar cost models, so I am only picking out the unusual aspect of the spacecraft.
3. The report states 3 wheels (slides 23, 53). Are these redundant (slide 54, 58) for both parallel and perpendicular? For a 5-year mission they should be.
4. Is the harness mass just for the cryo instrument? 100 kg or 63 kg both seem high for cryo cables. The $10M for harness design and implementation (slide 91) seems high. Cables above the spinning section interface should be carried in the payload WBS.
5. Surely one can find analogies for bipods (e.g. Spitzer) and v-groove Planck costs (slide 89) and performance (slide 115). The Planck V-groove design and performance is a reasonable starting point for heritage.
6. One can cite experience with Planck, Herschel and Spitzer in avoiding contamination problems from the thrusters (slide 105) on both the panels and the cryogenic optics. Worth mentioning, since contamination is a frequent topic for reviewers.
Minor - Instrument
1. Comment about contamination venting from detectors on to optics is amusing (slide 11), but I think Planck decontamination process is good heritage.
2. I see no benefit to mentioning MKIDs, only downside.
Jamie
Bill's Comments
Hi Shaul,
I looked through slides 127-142, doing my best to discern content hidden behind the jargon and acronyms. As far as I can tell, there is probably a sensible costing of the I&T of the spacecraft based on considerable heritage of this relatively simple platform. It didn't seem to clearly indicate the cost and schedule drivers for the science instrument. Is that to be found elsewhere? Best I could find was slide 31 of the second document, WBS 5.04.12 I&T budget of 6M$
There are some inconsistencies on slide 34, including the headline cost of the telescope (6.47 or 6.07 M$?). When I run the model using the same inputs I get something higher than either. Maybe they are using the projected diameter? This cost claims to include the I&T? That includes cold metrology? I think the cost of this will be significantly higher.
The sum of these two items is *less* than what they have budgeted for the computer to do the data compression. I cannot imagine how the computer would be this expensive (it is trivial), nor can i imagine how the former would fit in that budget.
Is the science instrument (cryo+optics+detectors+readout) I&T budgeted elsewhere, that I have missed?
Slide 75 of the draft report cites a design weakness that TES detectors have not been operated in space. I think this is not fair - the TES and both the tMUX and fMUX have been tested on autonomous balloons. This is the same level of technical readiness as the detector technology flown on Planck and Herschel. PICO does not have less heritage than these missions did, at least in this regard.
Bill